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PREFACE 


This  study  represents  a  portion  of  the  work  being  done  under  Project  1 123,  Flying 
Training  Development,  under  the  direction  of  Dr.  William  V.  Hagin.  This  effort  was 
documented  under  Task  112301,  Development  of  Performance  Measurement  Techniques 
for  Air  Force  Flying  Train]  lg,  and  Work  Unit  11230105,  Further  Development  of 
Automated  GAT-1  Performance  Measures;  Dr.  Edward  E.  Eddowes  Task  Scientist  arid 
Contract  Monitor. 

The  ^search  was  accomplished  by  Dr.  John  W.  Hill,  Bioinformation  System  Group, 
Stanford  Research  Institute,  under  Contract  Numoer  F41609-72-C-0012.  This  effort 
covered  the  period  of  time  between  Januaryl971  and  May  1973. 
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FURTHER  DEVELOPMENT  OF  AUTOMATED  GAT-I  PERFORMANCE  MEASURES 


I.  lNTRODl'CU'JN 

Pilot  proficiency  has  previously  been  measured  subjectively,  and  the  resulting  unreliability  and  lack  of 
precision  have  made  comparisons  of  pilot  training  programs  a  major  problem.  Consequently,  various 
automated  measurements  have  been  sought  by  previous  investigators.  Early  work  by  Krendel  and  McRuer 
(1960)  showed  no  differences  in  single-axis  compensatory  tracking  ability  with  pilot  proficiency;  the 
ultimate  skill  levels  were  achieved  after  a  few  practice  sessions  for  till  the  subjects  (5s)  involved.  More 
recently,  Garber  and  Krasnitskii  (1968)  found  a  small  group  of  psychophysical  variables  that  correlate  with 
progress  on  initial  flight  training.  Goebel,  Baum,  and  Hagin(1971)  found  that  several  performance  measures 
obtained  from  undergraduate  pilots’  first  few  hours  of  training  time  in  a  GAT-1  correlated  with  future 
performance.  Their  test  battery  included  a  number  of  tasks  and  a  variety  of  measurements  on  each  task. 

This  report  describes  a  reanalysis  and  expanded  study  of  the  statistical  approach  of  Hill  and  Goebel 
(1971)  which  selected  test  measurement  that  discriminated  among  changing  pilot  skills  over  the  first  100 
hours  of  flight  training.  The  experimental  system  for  generating  these  measurements  consisted  of  a  GAT-1 
trainer  interfaced  to  a  small  on-line  computer.  Performance  measurements  were  based  on  16  flight  variables 
of  the  GAT-’  which  were  continuously  monitored  during  ten  simulated  flight  tasks.  Basic  performance 
measures  consisting  of  means  and  standard  deviations  of  selected  flight  variables  and  correlations  between 
pairs  of  variables  during  each  task  were  developed.  It  was  believed  that  in  sufficiently  complex  simulated 
flights,  the  5s’  differing  abilities  to  divide  their  attention,  and  hold  a  number  of  variables  constan*  could  be 
used  to  measure  their  different  skill  levels  based  on  their  different  amounts  of  flying  experienct,. 

Since  compensatory  tracking  affords  stable  measurements  of  human  performance,  especially  in  the 
crossover  region  (McRuer,  Graham,  Krendell,  &  Resner,  1965),  and  can  provide  a  number  of  models  of 
pilot  performance,  a  tracking  task  was  included  into  Experiment  1.  It  was  expected  that  two-dimensional 
tracking  in  the  GAT-1,  with  its  dependencies  on  several  flight  variables,  would  provide  bettei  discrimination 
of  pilots  on  the  basis  of  their  experience  than  the  single-variable  tracking  using  a  joystick  often  used  in 
studies  of  psychomotor  performance  in  the  laboratory. 

The  two-dimensional  tracking  tasks  (roll  and  pitch  tracking)  produced  a  surprisingly  large  number  of 
measurements  that  separated  the  three  experience  groups  of  pilots  studied  in  the  previous  Hill  and  Goebel 
(1971)  research.  Since  the  pilot-vehicle  describing  functions  from  the  roll-tracking  portion  of  the  roll  and 
pitch  tracking  task  accounted  for  such  a  large  number  of  discriminating  tracking  measurements,  an  assort¬ 
ment  of  new  tracking  tasks  involving  roll  tracking  was  explored  in  the  present  experiment.  One-,  two-,  and 
threc-dimensionai  tracking^tasks  were  included  in  the  second  experiment,  as  were  variations  in  the  ampli¬ 
tude  and  band-width  of  the  roll  command  signal.  Tracking  tasks,  based  on  the  new  flight  variables,  yaw, 
altitude,  and  ground  position,  ai:o  were  included. 

The  types  of  measurements  derived  from  the  tracked  variables  were  greatly  expanded  in  Experiment 
2.  A  frequency  analysis  of  the  coupling  between  variables  in  multicoordinate  tracking  tasks  (cross¬ 
frequency  analysis)  was  devised.  A  remnant  analysis  was  included  to  determine  smoothness  of  an  individual 
S’ s  internally  generated  response  in  carrying  out  a  task.  Several  variables  were  derived  from  the  describing 
function  by  fitting  different  constants  and  the  simple  crossover  model  of  McRuer  et  al.  (1965)  to  the 
individual  5’s  data.  Estimates  of  pilot  gain,  crossover,  and  equivalent  time  delay  were  obtained  from  the 
describing  function.  Similar  measures  were  derived  from  the  cross-frequency  and  emnant  analysis.  These 
new  tasks  and  new  families  of  measurements  resulted  in  an  increase  in  the  number  of  measurements  per5 
from  326  to  2,436. 

Because  of  an  error  in  the  calculation  of  describing  functions  of  the  previous  study  (Hill  &  Goebel, 
1971),  this  report  includes  a  complete  reanalysis  of  the  previous  data  with  corrected  describing  functions. 
Because  of  this  change,  and  an  additional  error  found  in  the  multivariate  discriminate  analysis  (the  previous 
stepwise  analysis  was  not  terminated  early  enough  in  the  step-by-step  procedure),  the  corrected  description 
of  the  previous  study  presented  in  this  report  as  Experiment  1  should  be  considered  a  replacement  for  the 
entire  previous  report  (Hill  &  Goebel,  1971). 
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II.  EXPERIMENT  1 


Background 

The  describing  functions  of  the  previous  study  were  not  correct  because  the  command  signal  used  for 
the  calculation  of  the  5  s  response  was  90  out  of  phase.  This  problem  was  corrected  by  using  the  function 
X(8  +  1)  ~~  1 .  where  g  is  the  previous  gain  and  X  is  the  ratio  of  the  correct  command  signal  to  the  previous 
command  signal.  During  this  recalculation,  several  new  variables  were  derived  from  the  old  data  to  maxe  the 
old  data  comparable  with  the  data  of  the  new  experiment.  The  variables  added  are  given  below  and  the 
calculations  for  obtaining  them  are  described  in  Appendix  A: 

-Gains  measured  in  decibels 
-High  frequency  gain 
-High  frequency  crossover 
-High  frequency  phase 
-Low  frequency  gain 
-Low  frequency  crossover 
-Low  frequency  phase 
-Equivalent  time  delay 

The  second  problem  with  the  previous  data  analysis  was  that  no  limit  for  terminating  the  multivariate 
discriminant  analysis  was  placed  on  the  step-by-step  procedure.  The  previous  analysis  terminated  itself  after 
27  steps,  ideally  separating  the  three  groups  of  ten  5s.  This,  of  course,  represents  a  perfectly  solvable 
problem  and  a  statistical  procedure  is  not  necessary  to  solve  it;  27  linear  equations  in  27  unknowns  is  a 
straightforward  problem  of  algebra.  The  multivariate  analyses  were  repeated  using  a  realistic  limit1  to 
determine  if  an  added  variable  in  the  analysis  significantly  contributed  to  the  separation  of  the  groups. 
When  no  additional  variables  were  found  that  met  this  criterion,  the  analysis  was  terminated  automatically. 

Method 

Apparatus.  An  existing  interface  between  a  link  General  Aviation  Trainer  (GAT-1)  and  a  L1NC-8 
computer  system  (described  by  Hill,  Gardiner,  &  Bliss,  1969)  was  enlarged  to  permit  continuous  monitoring 
of  eight  flight  variables  (airspeed,  altitude,  climb,  roll,  pitch,  heading,  glideslope,  and  localizer)  and  to  allow 
the  computer  to  supply  signals  to  two  GAT-1  variables  (roll  and  pitch)  for  tracking  tasks.  Computer 
processing  of  the  data  to  provide  usable  output  was  divided  into  two  stages  because  of  the  limited  memory 
size  and  computational  power  of  the  LINC-8  computer.  The  L1NC-8  was  used  to  accumulate  simple  sums, 
cross  products,  and  Fourier  sums;  and  to  generate  the  sums  of  sines  command  signals  on  line.  The  time  scale 
for  these  accumulations  was  based  on  a  1 5-Hz  clock.2  The  variables  were  sampled,  and  sum,  products,  and 
command  signals  were  updated  every  1/15  second.  The  sums  output  from  the  LINC-8  recorded  on  paper 
tape  at  the  end  of  die  test  runs  were  further  processed  by  formula  translation  (FORTRAN)  programs  to 
calculate  the  means,  standard  deviations,  correlation  coefficients,  and  gains  and  the  phase  shifts  for  the 
tracking  tasks. 

Three  hundred  and  twenty  six  individual  test  measurements  were  made  for  each  5  over  the  four-task 
test  series.  Many  measurements  had  the  same  name  but  were  measured  in  different  tasks.  Consequently,  a 
numbering  system  was  used  to  identify  each  of  them.  The  numbering  system  is  given  in  Appendix  B  by 
numbers  placed  to  the  right  of  the  computer  printout  in  the  same  relative  positions  as  the  values  of  the 
measurements. 

Subjects.  Thirty  5s  (three  groups  of  ten)  were  selected  on  the  basis  of  their  flying  experience  and 
were  run  through  the  test  series.  Subjects  in  the  beginner  (B)  group  had  little  or  no  flying  experience  (less 
than  ten  hours);  5s  in  the  intermediate  (I)  group  had  moderate  experience  (25  to  50  hours);  and  5s  in  the 


1  A  description  of  the  program  BMD07M,  including  a  description  of  the  step-by-step  calculations  performed,  is  given 
in  References  7.  The  F  to-enter  and  F-to-delete  levels  were  set  to  2.5,  and  the  tolerance  level  was  set  to  0.0001  for  all 
computations  reported. 

A  stable  clock  was  obtained  by  dividing  the  60-Hz  line  frequency  by  4. 
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advanced  (A)  group  had  extensive  experience  (more  than  100  hours)  and,  in  addition,  had  logged  20  or 
more  hours  in  the  previous  six  months.  The  majority  (approximately  80  percent)  of  the  Ss  had  1-1/2  hours 
of  experience  in  the  GAT-1  trainer  from  a  previous  flight  test.  Many  5s,  expecially  the  advanced  pilots, 
volunteered  for  the  tests;  others  were  obtained  by  offering  them  $5.00  for  a  2-1/2  hour  session. 

Procedure.  A  pre-test  pilot  familiarization  period  and  four  simulated  flight  tasks  were  selected  for  the 
experiment.  They  are  described  as  follows. 

Pilot  Familiarization 

Each  S  was  asked  to  perform  the  following  series  of  maneuvers  to  become  accustomed  to  the  GAT-1 
and  its  flight  characteristics  prior  to  his  attempting  the  experimental  test  tasks: 

(1)  A  takeoff  and  climb  to  1000  ft  heading  due  east. 

(2)  A  180°  left  standard  rate  level  turn  in  1  minute. 

(3)  A  180°  right  standard  rate  level  turn  in  1  minute. 

(4)  A  500  ft  climb  at  500  ft/minute. 

(5)  A  power  change  to  1800  rpm  and  back  to  2400  rpm. 

(6)  A  500  ft  descent  at  500  ft/minute  while  keeping  airspeed  at  1 00  mph. 

(7)  A  level  flight  while  switching  on  half  flaps  and  then  full  flaps  and  maintaining  altitude  at  1000 
ft. 

This  familiarization  procedure  took  from  15  to  30  minutes,  depending  on  the  S.  More  warming-up 
time  was  spent  with  the  B  group  than  with  the  I  or  A  groups.  If  a  5  did  not  reasonably  complete  one  of  the 
warm-up  maneuvers,  he  was  given  a  second  opportunity  before  going  on  to  the  next. 

Simulated  Flight  Tasks 

(1)  Task  I -Roll  and  Pitch  Tracking. 

In  this  test  the  S  was  instructed  to  hold  altitude  at  1000  ft  and  heading  at  90°  (due  east)  while 
maintaining  level  flight  with  a  power  setting  of  2400  rpm.  He  was  told  that  a  simulated  rough  air  would 
make  the  trainer  pitch  and  roll  slowly  and  that  he  was  to  maintain  altitude  and  heading  as  well  as  possible 
during  the  test  run. 

This  test  was  basically  a  two-coordinate  compensatory  tracking  task  with  sum-of-sine-wave  command 
signals  introduced  into  the  roll  and  pitch  axes  to  simulate  rough  air.  The  amplitudes  of  the  individual 
command  frequencies  are  given  in  Tables  1  and  2.  In  addition  to  the  means,  standard  deviations,  and 
correlations  among  the  six  monitored  variables,  the  gain  and  phase  of  the  pilot-vehicle  describing  function 
for  both  roll  and  pitch  tracking  were  recorded. 


Table  1.  Amplitudes  of  the  Roll  Command 
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7 able  2.  Amplitudes  of  the  Pitch  Command 
Frequencies  (Tasks  1,  II) 


Numbtr  of 

Cycles  In  Run 

Frequency 

(Hz) 

Amplitude 

(degrees) 

2 

0.004 

30.05 

7 

0.014 

8.57 

14 

0.027 

4.44 

27 

0.053 

2.27 

59 

0.115 

1.04 

81 

0.158 

0.76 

145 

0.283 

0.42 

274 

0.535 

0.22 

A  long  warm-up3  time  (34.2  seconds)  was  provided  in  this  test  to  allow  the  S  to  adapt  to  the 
command  signals  that  started  abruptly  with  the  onset  of  the  run.  During  the  remainder  of  the  test  (545 
seconds)  the  S  s  performance  was  continuously  monitored.  The  six  flight  variables  monitored  in  this  test  are 
listed  in  the  computer  printout  shown  in  Appendix  B  under  the  analysis  entitled  “Roll  and  Pitch 
Tracking.” 

(2)  Task  11-Roll  and  Pitch  Tracking  with  Power  Changes. 

Task  II  was  identical  to  Task  I  except  that  he  S  was  additionally  required  io  perfoim  the  series  of 
power  changes  according  to  the  schedule  shown  in  Table  3.  As  in  Task  1  the  S  first  set  up  the  trainer  with 
proper  altitude  (1000  ft),  heading  (90°),  and  power  (2400  rpm).  Then  he  set  the  minute  hand  of  the 
aircraft  clock  to  between  1  and  2  minutes  before  the  hour  and  continued  to  hold  heading  and  altitude 
When  the  time  reached  0  minutes  and  0  seconds,  the  S  called  “Mark”  to  the  experimenter  (£),  who  started 
the  computer.  The  variables  measured  in  Task  II  are  shown  in  Appendix  B  under  the  analysis  entitled  “Roll 
and  Pitch  Tracking  with  Power  Changes.” 


Table  3.  Sequence  of 
Power  Changes  for  Task  IF 


Time  after  Start 
(min) 

Power 

(RPM) 

1 

2000 

3 

2600 

5 

2000 

7 

2600 

9 

2400 

(3)  Task  III -Flight  Profile. 

This  test  task  consisted  of  five  short  (2  to  3  minute)  maneuvers  performed  in  quick  succession  The 
sequence  of  maneuvers  is  shown  in  Table  4.  The  S  set  up  the  clock  as  in  Task  II  and  called  “Mark”  at  the 
begmmng  of  the  first  maneuver  (time  0)  and  at  the  beginning  of  the  other  maneuvers,  as  indicated  in  Table 
4.  When  h  heard  “Mark”  he  started  the  computer  monitor.  The  S  was  monitored  for  only  the  first  75 
percent  (approximately)  of  each  maneuver,  to  keep  the  mean  (light  measurements  from  being  biased  if  S 
completed  the  maneuver  too  qutckly  and  to  allow  E  time  for  entering  commands  at  me  teletype  to  set  up 
for  the  next  maneuver.  1 


The  warm-up  time  was  a  time  before  the  S’ s  performance  was  monitored,  during  which  the  LINC-8  generated  the 
sum-of-sincs  command  signals.  6 
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Table  4.  Sequence  of  Events  in  the  Flight 
Profile  (Task  HI) 


Manauvar  GAT-1 

Monitoring  Duration  Tima 

(*)  (min)  Subtaski 


Pretest 


A.  Climb  -  95  0 

B.  Right  turn -95  2-1/2 

C.  Slow  flight  - 145  5 

D.  Descending  turn  -  85  8 

E.  Descent -85  10 


Hold  altitude  at  500  ft 
Hold  heading  at  90° 

Hold  power  at  2400  rpm 

Call  “Mark” 

Change  power  to  2600  rpm 
Climb  at  500  ft/min  to  1 500  ft 

Call“Mark” 

Start  right  standard  360°  turn 
Hold  altitude  of  1 500  ft 
Hold  airspeed  of  1 10  mph 

Call  “Mark” 

Reduce  speed  to  80  mph 
Hold  altitude  at  1 500  ft 
Hold  heading  at  90° 

Call  “Mark” 

Switch  on  half  flaps 
Lower  power  to  1 200  rpm 
Start  left  standard  360°  turn 
Descend  at  500  ft/min  to  500  ft 

Call  “Mark” 

Switch  on  full  flaps 
Raise  power  to  2500  rpm 
Descend  at  250  ft/min  to  ground 
Hold  heading  at  90° 


The  flight  variables  monitored  and  the  output  in  each  of  the  five  maneuvers  are  given  in  Appendix  B. 
No  command  signals  were  generated  by  the  computer  for  the  flight  profile,  but  the  rough  air  (internally 
generated  by  the  GAT-1)  was  kept  at  its  maximum  value  for  the  duration  of  the  test. 

(4)  Task  IV-ILS  Landing  Approach 

In  this  final  task  S  was  instructed  to  climb  to  2300  ft  with  power  at  2400  rpm  and  a  heading  of  288° 
and  fly  toward  the  simulated  airport  at  Seaport  Beach.  In  addition  to  the  instrument  heading,  a  visual 
airport  reference  was  used  consisting  of  a  piece  of  paper  pinned  to  the  cloth  drape  surrounding  the  trainer 
at  a  compass  heading  of  288  .  The  GAT-1  position  plotter  was  used  to  position  the  trainer  approximately 
12  miles  from  the  airport,  directly  on  the  approach  beam.  As  the  5  flew  into  tire  glide  slope  beam  and  the 
glide  slope  needle  crossed  zero,  he  was  instructed  to  call  “Mark”  to  E  and  to  begin  descending  at  1 00  mph, 
while  keeping  the  glide  slope  and  localizer  needles  crossed. 

Since  many  of  the  Ss  had  never  flown  an  instrument  landing  system  (1LS)  approach,  even  many  of 
the  Ss  in  the  A  group,  a  warm-up  was  given  before  the  monitored  test.  The  warm-up  consisted  of  placing  an 
S  on  the  localizer  beam  before  he  started  climbing  to  2300  ft  and  letting  him  follow  the  beam  while 
climbing,  and  then  again  whUe  descending  several  hundred  feet  on  the  beam  after  the  glide  slope  had  been 
intercepted.  During  the  warm-up  period  E  gave  S  verbal  help  to  keep  him  on  the  beam  and  suggested  the 
strategy  for  returning  to  the  beam  if  he  drifted  off.  After  this  warm-up,  the  data  run  began,  and  the 
variables  given  in  Appendix  B  were  monitored. 


In  each  of  the  monitored  runs,  for  each  of  the  simulated  flight  tasks  described  above,  all  the 
unchanging  flight  variables  were  monitored,  but  the  remaining  variables  were  not.  For  example,  in  a 
descending  turn,  altitude  and  heading  were  not  monitored,  but  airspeed,  rate  of  dpscent,  roll  angle  and 
pitch  angle  were  monitored. 

Determination  of  Discriminative  Efficiency  of  Test  Measures.  A  one-way  analysis  of  variance  was 
performed  on  each  of  the  326  sets  of  test  measurements  to  determine  the  ability  of  each  measure  to 
distinguish  independently  among  the  beginning  (B),  intermediate  (1),  and  advanced  (A)  gr  ,  s  of  5s.  This 
use  ol  the  analysis  ol  variance  statistic  is  not  in  accordance  with  standard  practices  in  psychological  research 
and  is  in  error  judged  by  conventional  criteria.  The  rationale  for  this  nonstandard  use  of  analysis  of  variance 
is  presented  subsequently  and  may  be  evaluated  best  in  view  of  the  specific  requirements  of  the  study.  The 
distribution  of  the  F  values  obtained  from  there  analyses  is  shown  in  Table  5.  In  terms  of  the  number  of 
test  variables  with  an  F  value  greater  than  the  limit  shown  and  less  than  the  next  higher  limit  shown.  The  50 
measures  with  which  it  was  possible  to  reject  the  null  hypothesis  for  the  three  groups  of 5s  at  the  5-percent 
level  (F  greater  than  3.35)  are  shown  in  Table  6,  together  with  the  significance  level  achieved.  In  addition, 
Table  6  gives  the  mean  of  the  measure  for  each  group,  the  mean  over  all  three  groups,  and  the  standard 
deviation  oyer  all  three  groups.  The  50  statistically  significant  variables  have  been  marked  in  the  annotated 
final  analysis  printout  of  Appendix  B  so  that  they  may  be  easily  identified  by  name. 


Table  5.  Distribution 
of  F  Values  for 
Experiment  1 


F  Limit! 

Sianiflcanca 

Varlablai 

0 

0.50 

157 

1.0 

44 

1.5 

28 

2.0 

27 

2.5 

0.10 

15 

3.0 

5 

3.35 

0.05 

14 

4.24 

0.025 

18 

5.49 

0.01 

4 

6.49 

0.005 

3 

7.81 

0.002 

3 

8.81 

0.001 

8 

Total 

326 

To  determine  which  of  the  four  flight  tests  and  which  of  the  generic  types  of  variables  measured  in 
the  tests  contributed  most  to  differentiation,  the  summary  shown  in  Table  7  was  made.  Of  the  four  tasks, 
Tasks  I  through  III  contributed  high  proportions  of  significant  variables  (based  on  the  number  significant 
divided  by  the  total  number  available  from  each  task).  Only  9  percent  of  the  Task  IV  variables  were 
significant.  Since  all  the  tasks  contributed  measures  which  discriminated  among  the  B,  I  and  A  groups,  it 
appears  that  a  group  of  tests  requiring  several  different  skills  and  types  of  coordination,  should  be  used’ to 
differentiate  between  the  skill  levels  of  pilots,  rather  than  only  one  test. 

Of  the  four  types  of  measurements  made  in  the  tasks  (means,  standard  deviations,  correlations,  and 
tracking  parameters),  the  standard  deviations  produced  the  highest  proportion  (32  percent)  of  the 
significant  differences  between  5s.  The  tracking  measurements  were  second  best  (after  standard  deviations) 
in  ability  to  separate  the  groups  of  5s,  with  18  percent  of  them  being  significant.  A  breakdown  of  the 
racking  measures  into  those  obtained  in  roll  and  pitch  tracking,  also  giver  jn  Table  7,  shows  that  almost  all 
the  significant  tracking  measures  were  obtained  from  roll-tracking  gains.  In  fact,  roll  tracking  was  the  most 
efficient  task  for  generating  significant  measures  with  34  percent  of  those  measured  significant  at  the  5 
percent  level.  The  most  efficient  variables  of  all  were  the  roll  gains,  with  19  of  the  32  measures  (59  percent) 
statistically  significant.  ' 


Table  6 


STATISTIC ALLY-SIGNIFICANT  VARIABLES  FROM  EXPERIMENT  1 


VARIABLE 

F 

significance 

B  MEAN 

22 

4.34 

.025 

.015160 

27 

4.02 

.050 

.016330 

32 

3.64 

.050 

23.504 

35 

5.51 

.010 

1.186 

36 

9.92 

.001 

.655200 

IT 

9.43 

.001 

.412370 

IS 

4.81 

.025 

•325440 

75 

4.77 

<  02* 

2.948 

77 

4.86 

.025 

2.967 

98 

6.28 

.010 

7-133 

100 

11.48 

.001 

1.116 

101 

10.71 

.001 

.594570 

102 

4.59 

.025 

.423820 

112 

3.39 

.050 

433,525 

ns 

4.00 

.050 

1.988 

no 

3.79 

.050 

2.008 

156 

4.93 

.025 

6.079 

15S 

1 . 66 

.050 

186.621 

160 

3,99 

.050 

2.519 

172 

4.99 

.025 

1409. 

173 

3.63 

.050 

10.675 

177 

5.89 

.010 

7.767 

1S1 

4.34 

.025 

2.417 

104 

5.26 

.025 

-.284770 

199 

5.04 

.025 

-.454580 

199 

3.40 

•  050 

-439.375 

201 

4.74 

.025 

156,234 

5.13 

.025 

2.318 

206 

4.97 

.025 

-.457200 

209 

?i67 

.050 

-.298590 

210 

5.19 

.025 

.577790 

211 

3.88 

.050 

-173.125 

261 

7.27 

.005 

5.606 

263 

7.27 

.005 

5.642 

245 

4.66 

.025 

1.163600 

26S 

4.53 

.025 

26.734 

270 

3.48 

.050 

9,372 

271 

3.83 

.050 

.610 

272 

8,49 

.002 

-4.475 

273 

8.62 

.002 

-8.392 

274 

5.94 

.010 

-9,800 

278 

8.40 

.002 

-5.514 

284 

7.61 

•  005 

15,552 

286 

10.96 

.001 

•  449 

287 

10.58 

.001 

-5.325 

288 

5.03 

.025 

-8.120 

290 

5.16 

.025 

22.231 

293 

9.23 

.001 

-5.814 

294 

11.30 

•  001 

.119520 

322 

3.64 

.050 

-165,987 

1  mean 

A  MEAN 

MEAN 

STD.OEv 

.080270 

-.039740 

.018563 

.091176 

.077060 

-.037080 

•  01877(* 

.0900C* 

33.332 

50,193 

35. .^6 

22.365 

1.637 

2.083 

1,636 

.604 

.922570 

1.190650 

.92280/ 

.26885:. 

.549650 

.712370 

.5581  VO 

.154226 

.414300 

.466830 

.402/90 

.103066 

2.249 

1.530 

2.242 

1.026 

2,137 

1.535 

2  213 

1.031 

8,072 

14.731 

9,<? 

5.226 

1.381 

2.004 

1,500 

,393 

.851930 

1.117000 

.754500 

.252398 

.534080 

.628920 

.528940 

.151540 

441,600 

462,22s 

445,783 

25.413 

2,154 

1.223 

1.788 

.785 

2.121 

1.242 

1.791 

.776 

5.832 

3.968 

S, 293 

1  .644 

192,167 

126,796 

168.528 

59.913 

2.506 

1.858 

2.294 

,599 

1437. 

1489, 

1445. 

57. 

22,925 

38.725 

24.108 

23.343 

6,214 

4,511 

6.164 

2.123 

1,917 

1.521 

1.952 

.682 

.032620 

.015760 

-.078797 

.246315 

.206610 

-.225190 

-.295460 

.194462 

476,100 

-385.000 

-433.492 

78,609 

174.024 

96,985 

142,414 

58.564 

2,460 

1.403 

2.060 

.801 

,696710 

*. 266030 

-.473313 

.306110 

.445960 

-.192420 

-.312323 

.210122 

.725500 

.57i330 

.624873 

.121057 

169,725 

-211,400 

-184,750 

37.173 

3,749 

2.803 

4.053 

1,672 

3,933 

2,829 

4.135 

1.662 

.629900 

.543600 

.779033 

.492202 

28,377 

32.983 

29,421 

4.709 

12.919 

14.394 

12.228 

4.373 

2.930 

6,136 

3.225 

4.481 

-1.091 

1,328 

-1.413 

3.164 

-5,536 

-3.103 

-5,677 

2.851 

-8.087 

-6.763 

-8.217 

1.976 

-2.946 

-.600 

-3.020 

2.681 

17.609 

22.559 

18.573 

4.129 

2.353 

5.932 

2.911 

2.659 

-1.683 

.745 

•2.088 

2.971 

-5,747 

-4.218 

-6,028 

2.772 

24,000 

27,863 

24,698 

4,011 

•3.34J 

-1.344 

-3,500 

2.331 

.161580 

.215440 

.165513 

.045221 

133.117 

-145.311 

•148,138 

27.532 

tl 
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Table  7.  Breakdown  of  the  Important  Variables 
in  Experiment  1 


Sourca  of 

Variables 

Number  of 
Available 
Variables 

Number 
Significant 
(5%  Test) 

Percentage 
Significant 
(5%  Test) 

Task  I 

95 

15 

16 

Tasfc  11 

95 

14 

15 

Task  III 

101 

18 

18 

Task  IV 

35 

3 

9 

Task  Totals 

326 

50 

Means 

44 

5 

1  1 

Deviations 

44 

14 

32 

Correlations 

102 

7 

7 

Tracking 

136 

24 

18 

Variable  Totals 

326 

50 

Roll  gains 

32 

19 

59 

Roll  phases 

16 

■) 

0 

Roll  derived 

20 

4 

20 

Ptich  gains 

32 

0 

0 

Pitch  phases 

16 

0 

0 

Pitch  derived 

20 

1 

5 

Tracking  Totals 

136 

24 

To  understand  better  the  differences  amon[;  pilot  group;  evidenced  in  the  pilot-vehicle  describing 
function  (gains  and  phases),  the  describing  function;  for  Task  \  shown  in  Figures  1  and  2  were  studied. 
Where  differences  among  groups  exist,  they  were  repe<i«able  across  the  frequency  spectrum.  It  is  obvious 
from  Figures  1  and  2  that  the  two  derived  variables,  high  and  low  frequency  roll  gain,  contain  all  the  useful 
gain  information  in  the  roll-describing  function  for  separating  groups.  The  low  frequency  roll  gain 
differences  were  not  significant  because  of  their  normal  high  variability,  but  differences  in  high  frequency 
pitch  phase  were  significant,  with  the  B  group  showing  greater  phase  shift  (equivalently  greater  lag  or 
reaction  time)  than  the  I  or  A  groups. 

The  correlation  coefficients  were  the  least  productive  in  showing  significant  differences  among  pilots. 
Since  only  7  percent  of  them  were  significant  at  the  5  percent  level,  there  is  little  evidence  to  indicate  that 
they  contribute  to  pilot  skill  differentiation  and  probably  the  correlations  should  be  eliminated  from  the 
tests.  On  the  other  hand,  only  5  percent  of  the  pitch  tracking  measures  were  significant  at  the  5  percent 
level. 


III.  DISCRIMINANTS  IDENTIFIED  IN  EXPERIMENT  1 

One  of  the  objectives  of  this  study  is  to  determine  statistically  the  measures  that  can  be  used  to 
define  or  evaluate  pile  t  performance  over  the  first  100  hours  of  training.  The  approach  is  to  use  a  linearly 
weighted  sum  of  automated  performance  measures  (a  discriminant  or  factor)  that  optimally  differentiates 
among  the  three  groups  of  Ss.  Different  means  of  obtaining  this  discriminant,  using  an  analysis  of  variance 
and  a  “canned”  stepwise  multivariate  discriminant  analysis  program,  are  described  in  this  section.  Three 
discriminant  functions  were  obtained  from  the  data  pool  of  Experiment  1  for  later  application  to  the  data 
pool  of  Experiment  2.  This  comparison  allows  estimation  of  the  usefulness  and  reliability  of  the  three 
methods  for  obtaining  such  discriminants  described  in  this  section. 
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SHIFT  —  degrees  GAIN 


SA-1 676-2 


FIGURE  1  PILOT-VEHICLE  DESCRIBING  FUNCTIONS  FOR  ROLL 
TRACKING  IN  TASK  I 

Each  data  point  represents  the  average  of  ten  subjects. 
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FIGURE  2  PILOT-VEHICLE  DESCRIBING  FUNCTIONS  FOR  PITCH 
TRACKING  IN  TASK  I 

Each  data  point  represents  the  average  of  ten  subjects. 
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AM  Discriminant -Determined  by  Analysis  of  Variance 
Followed  by  Multivariate  Discriminant  Analysis 

This  two-stage  method  of  determining  a  discriminant  is  based  on  an  initial  selection  ot  mesures  using 
a  one-way  analysis  of  variance  ot  each  measure  to  determine  its  ability  to  separate  correctly  the  different  per¬ 
formance  of  the  three  groups  of  subjects.  The  resulting  set  of  measures  with  an  acceptable  significance  level  is 
entered  into  a  multivariate  discriminant  analysis  program.  The  primary  requirement  for  this  two-stage 
method  is  to  reduce  the  size  of  the  set  of  measures  set  so  all  measures  found  to  discriminante  satisfactorily 
between  B,  I  and  A  groups  may  be  entered  simultaneously  into  the  analysis  program.  The  multivariate 
program  handles  only  71  variables  while  in  Experiment  1  there  were  326  measures;  consequently,  the 
one-way  analyses  of  variance  were  employed  in  identifying  the  “best”  7 1  of  326  for  entry  into  the  multiple 
discriminant  analysis. 

The  distribution  of  F  values  shown  in  Table  5  was  used  to  select  tne  measures  for  input  to  the 
multivariate  discrimination  program.  The  set  of  measures  with  h  values  larger  than  a  given  h  criterion 
consisted  of  two  groups:  those  representing  a  real  difference  among  the  three  experience  level  groups  of 
pilot  subjects,  and  those  representing  chance  statistical  fluctuations  in  the  data.  As  the  criterion/7  value  is 
raised,  fewer  measures  are  included,  but  they  are  more  likely  to  show  real,  repeatable  differences.  As  the 
criterion  is  lowered,  more  variables  are  included,  and  a  larger  portion  cf  them  are  variables  significant  by 
chance,  showing  differences  among  groups  that  will  not  be  repeated  in  subsequent  tests. 

As  a  compromise  between  losing  important  yariables  and  gaining  variables  significant  only  by  chance, 
an  F  criterion  of  2.5  was  chosen.  This  value  is  achieved  by  10  percent  of  the  Fs  computed  on  samples 
drawn  from  the  same  population.  A  smaller  F  criterion  would  begin  to  include  more  false  positives  than 
positives,  and  a  larger  F  criterion  would  eliminate  too  many  discriminating  variables.  It  can  be  seen  that  the 
analysis  of  variance  statistic  was  used  to  aid  decision  making  in  a  way  other  than  that  lor  wh  h  it  is 
characteristically  employed. 

The  70  variables  meeting  the  F  =  2.5  criterion  were  entered  into  the  stepwise  multivariate 
discriminant  analysis  program,  BMD07M,  for  the  final  selection  of  the  most  important  flight  variables  The 
program  went  through  eight  iterations  before  it  stopped  adding  the  variable  with  the  highest  /•  value  at  each 
step  and  recomputing  the  F  values  of  the  remaining  unselected  variables  on  the  basis  of  the  remaining 
pooled  variance.  In  this  way,  eight  of  the  70  flight  variables  were  selected  by  the  program  as  being 
significant  in  discriminating  among  the  three  groups  of  pilots  before  the  F  level  of  the  remaining  variables 
became  lower  than  that  required  for  further  computation.  These  final  variables  are  listed  in  Table  8.  with 
their  initial  F  values  [2  and  27  df  (degrees  of  freedom)]  and  final  F  values  [2  and  20  df]  to  test  the  null 
hypothesis  among  the  three  groups.  The  variables  with  the  highest  final  F  values  are  the  most  efficient  in 
separating  the  three  groups. 


Table  8.  AM  Discriminant  Summary 


Variable 

Number 

Name,  Talk 

Initial 

F- Value 

Final 

F-Vilue 

tit  Canonical 
Coefficient 

2nd  Canonical 
Coefficient 

Grand 

Mean 

100 

.125  Hz  Roll,  tracking  gain,  Ii 

13.47 

18.04 

3.35 

-  .0179 

1.50 

153 

Climb  rate,  lll-B 

2.60 

8.12 

.0199 

-  .00749 

22.9 

189 

Pitch-altitude  correlation,  II1-C 

5.04 

6.01 

-  .613 

-5.67 

-  .295 

210 

Pitch-climb  correlation,  III-D 

5.19 

11.64 

-8.10 

-7.67 

.624 

225 

Pitch-airspeed  correlation,  Ill-E 

3.02 

6.54 

1.43 

4.39 

-  .396 

241 

Roll  standard  deviation,  IV 

7.27 

2.81 

-  .273 

-  .495 

4.05 

245 

Localizer  standard  deviation,  IV 

4.65 

6.41 

-1.710 

1.54 

.77" 

313 

.014  Hz  Pitch  tracking  gain,  II 

3.33 

11.23 

-  .235 

.0867 

25.6 

After  electing  the  variables  that  best  discriminate,  the  BMD07M  program  performed  a  coordinate 
rotation  in  eight-space  to  find  new  orthogonal  variables  (canonical  variables  or  factors)  that  account  for 
most  of  the  dispersion  (or  variance)  in  the  data.  The  value  of  the  two  canonical  variables,  C|  and  C2,  for 
each  pilot  in  the  test  series  is  given  by: 
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(1) 


r 

Ct  =  £  uj(xj  xj) 

j=l 

C2=  2  ^(Xj-fj)  (2) 

j=l 

Where  r  is  the  number  of  discriminating  variables  chosen  (eight)  in  this  case,  u.  and  v.  are  the  first  and 
second  canonical  weighting  coefficients,  x  is  the  value  of  the  eight  variables  obtained  for  the  given  pilot, 
and  x.  is  the  grand  mean  for  each  of  the  discriminating  variables.  These  data  are  given  in  Table  8.  The 
individual  values  of  the  two  canonical  variables  for  the  30  pilots  are  shown  in  Figure  3,  as  determined  from 
the  coefficients  and  grand  mean  of  Table  8  using  Eqs.  ( 1 )  and  (  2). 

MM  Discriminant-Determined  by  a  Two-Stage  Multivariate  Discriminant  Analyse 

A  second  procedure  for  selecting  the  variables  that  best  discriminate  among  the  three  groups  of 
subjects  is  to  break  the  326  variables  into  groups  of  71  or  fewer  variables  and  run  the  multivariate  analysis 
to  determine  the  variables  significant  in  separating  the  three  groups.  This  procedure  may  allow  more 
interaction  among  variables  in  separating  the  groups  than  the  previous  method. 

For  this  analysis  the  326  variables  were  divided  into  the  five  groups  shown  in  Table  9  and 
independently  entered  in  the  BMD07M  multivariate  discrimination  program.  The  last  group  (Group  5) 
contained  the  derived  tracking  variables  from  Task  I  and  II  added  in  this  reanalysis.  These  include  the 
tracking  gains  measured  in  decibels  and  the  constants  fitted  to  the  describing  function. 

The  47  selected  test  variables  were  again  entered  into  a  multivariate  discriminant  analysis  for  final 
selection.  Fifteen  of  the  47  flight  variables  were  selected  before  the  statistical  termination  procedure  was 
reached.  These  final  variables  are  listed  in  Table  10  with  their  initial  F  values  (2  and  27  df)  and  final  F 
values  (2  and  1 3  df).  The  individual  values  of  the  two  canonical  variables  for  each  of  the  305s  plotted  using 
the  coefficients  and  grand  means  of  Table  1 0  and  Eqs.  ( 1)  and  (2)  are  shown  in  Figure  4. 


Table  9.  Summary  of  First 
Multivariate  Analysis 


Variable 

Group 

Taikt 

Number  of 
Variables 

Number  of 
Significant 
Variables 

1 

I 

65 

6 

2 

II 

65 

17 

3 

III-A,  III-B,  III-C 

67 

11 

4 

III-D,  III-E,  IV 

69 

6 

5 

I,  II 

60 

7 

Total  of  all  tasks 

326 

47 

Close  examination  of  the  initial  F  values  of  the  MM  Discriminant  of  Table  10  reveals  that  more  than 
half  the  variables  chosen  (8  out  of  IS)  are  not  significant  (5%  test)  in  the  :  c bility  to  separate  the  three 
groups.  Several  variables  even  have  F  values  close  to  1.00  or  below  it,  su^gestiii,^  that  they  are  but  random 
variables  contributing  to  the  separation  of  the  30  particular  S%  ,(  the  S  pool  but  not  to  separation  of 
experience  groups  in  general. 
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FIRST  CANONICAL  VARIABLE  —  linear  trend 
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FIGURE  3  CLUSTER  PLOT  OF  THE  AM  DISCRIMINANT  APPLIED 
TO  THE  30  SUBJECTS  OF  EXPERIMENT  1 
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Table  10.  MM  Discriminant  Summary 


Variable 

Numbar 

Nam«,  Talk 

Initial 

F-Value 

Final 

F-Valua 

lit  Canonical 
Coefficient 

2nd  Canonical 
Coafflciant 

Grand 

Mean 

22 

Pitch-roll  correlation,  I 

4.34 

6.09 

-12.7 

-3.24 

.0186 

79 

Climb-airspeed  correlation,  II 

1.12 

26.41 

-30.4 

-2.99 

-  .180 

98 

.029  Hz  Roll  tracking  gain,  II 

6.28 

2.62 

.353 

.287 

9.97 

100 

.125  Hz  Roll  tracking  gain,  II 

13.47 

35.79 

8.15 

1.01 

1.50 

153 

Climb  rate,  III-B 

2.60 

27.95 

.050 

.007 

22.9 

183 

Airspeed-altitude  correlation,  III-C 

1.78 

9.58 

3.45 

4.29 

.108 

196 

Roll-yaw  correlation,  III-C 

.85 

6.61 

-  5.18 

3.16 

.950 

205 

Pitch  standard  dev.,  II1-D 

5.12 

2.82 

-  .142 

-1.35 

2.06 

210 

Pitch-climb  correlation,  III-D 

5.18 

23.56 

-23.6 

-1.75 

.625 

225 

Pitch-airspeed  correlation,  III-E 

3.01 

22.33 

7.66 

7.40 

-  .397 

241 

Roll  standard  deviation,  IV 

7.27 

31.64 

-  1.83 

.242 

4.05 

284 

.029  Hz  Roll  tracking  gain  (db),  11 

7.61 

7.37 

-  .620 

-  .876 

18.6 

291 

Low  frequency  roll  crossover,  II 

.50 

7.38 

-  .580 

.938 

.647 

307 

Low  frequency  pitch  phase  I 

.39 

14.95 

-  .100 

-  .114 

-195. 

313 

.014  Hz  Pitch  tracking  gain  (db),  II 

3.33 

9.98 

-  .208 

.265 

25.6 

FIRST  CANONICAL  VARIABLE  —  linear  trend 
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FIGURE  4  CLUSTER  PLOT  OF  THE  MM  DISCRIMINANT  APPLIED 
TO  THE  30  SUBJECTS  OF  EXPERIMENT  1 
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Because  of  the  concern  that  the  BMD07M  program  might  not  be  capable  of  meaningful  selection  of 
variables  from  a  large  base  (326)  using  only  27  df,  some  experiments  with  ra  idimly  generated  variables 
were  carried  out. 

Discriminants  from  Random  Pools  of  Variables 

Since  no  statistics  are  known  on  how  well  a  stepwise  multivariate  discriminant  analysis  can  be 
expected  to  select  from  pools  of  60  to  70  variables  to  differentiate  among  three  groups  of  10  subjects, 
empirical  d  were  obtained  by  running  the  program  with  random  numbers.  No  statistic  is  available  in  the 
BMD07M  piogram  for  determining  the  significance  of  the  v.riable  added  at  each  step  in  further  separating 
the  groups.  To  solve  this  problem,  the  calculation  of  Mahalanobis  distance,  D2  (approximately  chi  square 
distributed),  based  on  the  U  statistic  as  described  b>  Rao  (1970)  was  added  to  the  program.  Since  D2  is 
additive,  the  change  in  D2  (2  df)  with  each  added  variable  did  not  contribute  to  the  separation  among 
groups.  In  addition  to  the  incremental  D2  crlculation,  the  program  was  modified  to  print  out  the 
classification  matrix  after  each  step. 

To  obtain  empirical  distributions  of  the  D2  statistic  and  classification  speed,  the  following 
experiment  was  carried  out.  Ten  separate  sets  of  random  data  were  generated,  using  a  random  number 
generator.4  Each  set  of  data  consisted  of  70  random  number  (corresponding  to  flight  variables)  for  each  of 
30  hypothetical  “subjects.”  Ten  “subjects”  were  arbitrarily  assigned  to  each  group  (10  beginners,  10 
intermediate,  and  10  advanced).  Each  data  bank,  a  30  x  70  matrix  of  random  numbers  was  entered  into 
the  BMD07M  stepwise  discriminant  program. 

The  results  of  the  random  data  runs  were  quite  surprising.  Table  1 1  shows  the  number  of  “subjects” 
correctly  classified  by  the  stepwise  discrimination  procedure  for  each  of  the  first  12  discriminating 
variables.  It  can  be  seen  that  on  the  average,  the  best  one  of  the  70  random  “fiight  variables”  correctly 
classified  15.9  “subjects,”  and  on  the  average  only  nine  selected  random  “flight  variables”  are  needed  to 
classify  correctly  all  30  "subjects.”  The  most  typical  discriminant  of  the  ten  runs  (closest  to  average  in 
separating  ability)  is  shown  in  Figure  5. 

These  results  indicate  that  the  stepwise  multivariate  discriminant  procedure  is  being  misused  in  this 
application  where  it  is  expected  to  search  large  pools  of  variables  (from  appioximately  50  up  to  326)  to 
select  a  few  significant  variables.  Its  use  should  be  restricted  to  cases  where  tl>e  number  of  variables  in  the 
pool  is  much  less  than  the  number  of  pilots.  The  diversity  of  combinations  r  /ailablc  in  such  a  large  pool  of 
random  variables  is  put  to  quick  use  in  separating  groups. 


Table  11.  Number  of  “Random” 
Pilots  Correctly  Classified 


Number  of 
Discriminating 
Variables 

Worst  of 
Ten  Runs 

Average  of 
Ten  Runs 

Best  of 
Ten  Runs 

1 

14 

15.9 

18 

2 

17 

18.8 

21 

3 

19 

21.0 

24 

4 

19 

23.0 

26 

5 

22 

24.9 

28 

6 

22 

25.0 

29 

7 

23 

26.7 

30 

8 

25 

27.4 

30 

9 

27 

28.5 

30 

10 

28 

29.2 

30 

11 

29 

29.9 

30 

12 

29 

29.9 

30 

4Ten  uniformly  distributed  random  numbers,  each  obtained  by  the  CDC  6400  FTN  random  number  generator 
(RGEN),  were  summed  to  obtain  individual  samples  from  an  approximately  normally  distributed  process  having  a  mean  of 
5.0  and  standard  deviation  of  0.8. 
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FIRST  CANONICAL  VARIABLE 


linear  trend 
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FIGURE  5  CLUSTER  PLOT  OF  TYPICAL  RANDOM  DISCRIMINANT 
APPLIED  TO  30  HYPOTHETICAL  SUBJECTS 
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Experiment  1  Conclusions 

The  results  with  random  data  indicate  that  the  multivariate  discriminant  analysis  should  not  be  used 
as  a  selection  tool  in  this  application.  The  fact  that  the  majority  of  variables  in  the  MM  discriminant  are  not 
statistically  significant  in  their  own  right  suggests  that  the  MM  procedure  is  selecting  variables  that 
differentiate  among  the  particular  30  Ss  of  the  analysis,  but  will  not  be  useful  in  differentiating  among  new 
Ss.  This  failure  is  useful  because  it  suggests  a  rule  for  choosing  candidate  variables:  a  variable  must  be 
statistically  significant  in  separating  the  three  groups  of  Ss  by  itself.  Only  if  this  is  true  do  we  have  some 
assurance  that  the  variable  shows  a  difference  that  will  be  repeated  by  other  Ss. 

This  is  exactly  the  approach  used  to  obtain  the  AM  discriminant.  The  large  number  of  variables  (70) 
entered  in  the  multivariate  analysis,  however,  still  called  for  the  analysis  procedure  to  do  the  selection, 
possibly  causing  the  resulting  variables  to  be  weighted  so  that  particular,  unrepeatable,  differences  among  Ss 
are  used  to  differentiate  among  the  three  groups.  A  better  method  of  r  lection  would  be  to  increase  the 
level  of  confidence  (alpha)  criterion  for  acceptance  from  the  .10  level  previously  used  to  a  higher  level,  say 
the  .01  or  the  .001  level.  A  level  of  confidence  of  .01  in  this  study  would  have  reduced  the  number  of 
candidate  variables  from  70  to  18. 

In  addition  to  raising  the  significance  level  of  acceptance  of  a  variable,  common  sense  indicates  that 
many  of  the  variables  are  highly  correlated  and  hence  redundant,  and  that  some  generic  types  of 
measurements  are  not  effective  above  chance  in  generating  statistically  significant  variables. 

The  describing  functions  of  Figures  1  and  2  indicate  that  the  tracking  variables  are  highly  correlated. 
Where  differences  among  groups  exist,  they  are  repeatable  across  the  entire  frequency  spectrum.  Also, 
according  to  the  way  they  are  derived  from  these  curves  (Appendix  A),  gain  and  crossover  measures  are 
highly  correlated,  as  are  high  frequency  phase  and  equivalent  time  delay. 

The  results  of  Experiment  1  indicate  that  the  correlation  coefficients  do  not  moduce  significant 
variables  above  the  chance  level.  Only  7  out  of  102(6.8  percent)  are  significant  at  the  5  percent  level.  This 
is  less  than  half  as  many  as  the  other  families  and  suggests  that  the  correlations  are  not  reliable  in 
distinguishing  among  pilots. 

With  this  background,  the  following  rules  ‘"or  reducing  the  number  of  candidate  variables  are 
proposed: 

*  Rule  1  -  Eliminate  the  tracking  parameter,(descri  )ing  function)  in  favor  of  the  parameters  derived 

from  them. 

*  Rule  2  -  From  the  derived  tracking  parameters  eliminate  the  parameter  of  each  following  pair  with 

the  lowest  F  value. 

-Low  frequency  gain,  low  frequency  corssover 

-High  frequency  gain,  high  frequency  cross,  wer 

-High  frequency  phase,  equivalent  time  deity. 

*  Rule  3  -  Eliminate  the  102  correlation  coefficients. 

In  experiment  1,  application  of  Rule  1  would  eliminate  96  individual  tracking  gain  and  phase 
components  (Variables  31  to  46,  50  to  65,  96  to  1 1 1,  1 15  to  1 30, 267  to  274, 297  to  304, 283  to  289,  and 
312  to  319).  Application  of  Rule  2  would  eliminate  3  variables  from  each  of  the  4  tracking  analyses  (12 
variables)  that  are,  by  construction,  highly  correlated. 

Applying  these  three  rules  to  the  data  would  reduce  the  number  of  variables  from  326  to  1 16.  Using 
signifhance  level  as  the  last  criterion  for  selecting  a  small  number  of  variables  from  the  pool  of  1 16,  we  find 
5  qualifying  variables  above  the  0.01  level  and  14  above  the  0.025  level.  As  a  test  of  the  efficacy  of  these 
rules,  ea^h  of  these  groups  was  separately  entered  in  the  BMD07M  program,  and  the  two  discriminants 
obtained  were  identical  and  are  shown  in  Table  12  with  their  initial  F  values  (2  and  27  df)  and  final  F 
values  (2  and  26  df).  The  individual  values  for  the  two  canonical  variables  for  each  of  the  30  Ss  plotted 
using  the  coefficients  and  grand  means  of  Table  1 2  and  Eqs.  (1)  and  (2)  are  shown  in  Figure  6. 
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One  of  the  differences  among  the  RAM  discriminant  and  the  previous  discriminants  is  the  dominance 
of  the  linear  canonical  variable  m  separating  the  three  groups.  With  the  AM,  MM,  and  Random 
discriminants,  cluster  plots  had  a  triangular  shape;  with  the  RAM  discriminant,  the  clusters  lie  in  a  straight 
line.  This  difference  further  suggests  that  the  three  previous  discriminants  were  building  group  differences 
from  peculiar  differences  among  5s  in  the  305  pool  the  same  way  that  differences  can  be  built  up  by  using 
a  pool  of  random  numbers.  It  also  seems  logical  and  desirable  that  pilot  performance  measures  should  be 
measured  on  a  single  axis  (the  first  canonical  or  linear  variable)  of  increasing  skill  with  monotonically 
increasing  changes  from  B  through  1  to  A  groups  rather  than  the  up-down-up  changes  resulting  from  the 
second  canonical  (quadratic)  variable. 


IV.  EXPERIMENT  2 


Introduction 

Experiment  2  was  a  considerably  expanded  version  of  Experiment  1  designed  to  fulfill  the  following 
requirements: 

•  Replicate  the  measurements  of  Experiment  1  to  obtain  data  for  verifying  the  reliability  of  the 
discriminants  based  on  30  new  5s. 

•  Include  additional  flight  variables,  particularly  all  the  5s’ control  inputs  (throttle,  rudder,  elevator, 
and  aileron). 

•  Determine  if  roll  tracking  alone  was  the  task  that  discriminated  among  groups,  or  if  it  was  the 
particular  two-dimensional  tracking  procedure  used  in  Experiment  1.  For  (his  purpose  one-,  two-,  and 
three-dimensional  tracking  tasks  (including  roll)  were  explored,  as  well  as  tasks  with  varied  bandwidth  and 
amplitude  of  the  roll  command  signal. 

•  Experiment  with  several  types  of  direct  and  derived  tracking  measurements  based  on  the  remnant 
spectrum  and  cross-coupling  between  tracking  tasks. 

Method 

Apparatus.  In  this  experiment  more  flight  variables  were  recorded  and  controlled,  and  a  visual 
reference  system  was  added  as  shown  in  Figure  7.  The  interface  between  the  GAT-1  and  LINC-8  computer 
was  enlarged  to  allow  continuous  monitoring  of  eight  additional  flight  variables  (power,  absolute  heading, 
rate  of  turn,  rudder,  elevator,  aileron,  northing  from  a  reference  station,  and  radial  distance  from  a 
reference  station)  and  to  ;.ilow  the  computer  to  introduce  signals  into  three  additional  GAT-1  variables 
(yaw,  altitude,  and  north-south  position)  for  tracking  tasks. 

The  LINC-8  computer  program  was  modified  to  subtract  a  continuously  changing  ramp  function 
from  specified  variables  so  that  changes  from  the  required  profile  could  be  monitored.  For  example,  the 
actual  altitude  difference  from  the  profile  specified  by  500  ft/min  climb  starting  at  an  altitude  of  500  ft 
could  be  monitored  exactly  like  other,  unchanging  flight  variables.  The  ability  to  monitor  linearly  changing 
variables  was  used  to  follow  altitude  deviations  during  steady  climbs  and  descents  and  heading  deviations 
during  fixed  rate  turns. 

The  LINC-8  tracking  program  was  expanded  to  permit  tracking  command  signals  to  be  composed  of 
16  different  sine  wave  components.  The  Fourier  analysis  was  expanded  from  8  to  16  frequencies,  and  the 
ability  to  perform  Fourier  analysis  of  a  flight  variable  at  several  different  sets  of  frequencies  was  added. 
With  16  instead  of  8  data  points,  the  pilot-vehicle  describing  functions  were  expected  to  be  smoother  and 
the  variables  derived  from  them  (like  average  gain,  crossover  frequencies,  and  equivalent  time  delay)  were 
expected  to  be  more  stable.  Analyzing  one  flight  variable  at  the  frequencies  contained  in  the  command 
signal  of  another  flight  variable  is  called  a  cross-frequency  analysis.  The  cross-frequency  analysis  permitted 
the  coupling  from  one  variable  to  another  during  a  multidimensional  tracking  task  to  be  determined  (i.c..  in 
roll  and  pitch  tracking  how  much  of  the  pitch  command  the  5  coupled  into  roll  and  vice  versa).  Analyzing  a 
tracking  flight  variable  at  frequencies  not  in  any  command  signal  permitted  the  self-gcneratc  response  of  the 
pilot,  the  remnant,  to  be  measured.  Breaking  the  remnant  power  into  high  and  low  frequency  portions 
permitted  estimates  of  the  jerkiness  or  smoothness  of  the  5’s  control  handling  to  be  made. 
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LINC-8  COMPUTER 


T  A  -9  34583-6  R 


FIGURE  7  EQUIPMENT  CONFIGURATION  FOR  EXPERIMENT  2 


To  carry  out  simple  maneuvers  entailing  ground  reference,  the  simulated  ground  reference  system 
shown  in  Figure  8  was  built.  The  visual  reference  system  consisted  of  an  x-y  plotter  and  a  closed  circuit  TV 
system.  An  11  by  17  inch  commercial  x-y  plotter  was  used  to  indicate  the  x  and  y  coordinates  of  the 
GAT-1,  using  a  scale  of  approximately  1  inch  per  mile.  This  afforded  considerably  greater  resolution  and 
smoothness  than  the  original  plotter  supplied  with  the  GAT-1 . 

A  TV  camera,  positioned  about  3  ft  above  the  x-y  plotter  on  a  stand,  viewed  about  a  7  by  9  inch  area 
on  the  plotter’s  bed.  Served  from  a  potentiometer  in  the  base  of  the  GAT-1,  the  TV  camera  followed 
rotation  of  the  GAT-1.  In  this  way,  “up”  on  the  TV  monitor  always  corresponded  to  the  direction  of 
travel,  and  the  turning  direction  to  correct  position  errors  was  easily  measured. 

A  small  portable  TV  monitor  on  the  instrument  panel  of  the  GAT-1  provided  the  test  subject  with 
ground  reference  information.  On  the  monitor,  the  subject  saw  a  plot  of  his  required  ground  course  and  a 
small  moving  circle  (buDseye)  representing  the  position  of  the  aircraft  above  the  ground. 

Subjects.  Thirty  Ss  were  selected  on  the  basis  of  their  flying  experience,  using  the  procedure 
described  in  Experiment  1.  Many  Ss  in  the  advanced  group  volunteered  for  the  test;  the  remainder  were 
obtained  by  offering  them  $10.00  for  completing  two  test  sessions,  each  approximately  2.5  hours  long. 
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FIGURE  8  GROUNO  POSITION  VISUAL  DISPLAY  SYSTEM 

The  subject  observes  his  changing  position  (bullseye)  on  the 
ground  reference  using  closed-circuit  TV.  The  ground  track 
shown  represents  a  circle  2  miles  in  diameter. 


Procedure.  After  performing  the  same  warm-up  and  the  same  four  tasks  of  Experiment  1  (Tasks  I 
through  IV),  each  S  was  run  through  six  additional  tasks  (Tasks  V  through  X).  Since  2,436  individual  test 
measurements  were  made  on  each  S  in  the  test  series,  many  having  the  same  name  but  measured  in  different 
tests,  a  numbering  system  similar  to  that  used  for  the  variables  of  Experiment  1  was  used  here.  The  number 
of  each  measurement  is  given  in  Appendix  C  by  numbers  placed  to  the  right  of  the  computer  printout. 
When  more  than  one  measurement  is  printed  on  a  line,  the  variables  are  numbered  consecutively  from  left 
to  right  across  the  line  with  only  the  number  of  the  last  variables  on  the  line  being  given.  The  description  of 
the  computational  procedure  used  to  obtain  the  test  variables  is  given  in  Appendix  A. 

Pilot  Familiarization 

All  pilots  followed  the  same  warm-up  procedure  used  in  Experiment  1. 

Simulated  Flight  Tasks 

( 1 )  Tasks  I  Through  I V 

Task  I,  Roll  and  Pitch  Tracking;  Task  III,  Roll  and  Pitch  Tracking  with  Power  Changes;  Task  III, 
Flight  Profile,  and  Task  IV,  ILS  Landing  Approach,  were  the  same  as  the  corre;ponding  tasks  of 
Experiment  1  except  for  the  enlarged  set  of  measurements  obtained. 

(2)  Task  V  Roll  Tracking 

This  task  was  the  same  as  Task  I  in  both  its  requirements  of  the  S  a;.d  its  duration.  Instead  of  the 
separate  sum-of-sine  command  signals  introduced  into  the  roll  and  pitch  axes,  a  command  signal  was 
introduced  only  into  the  roll  axis.  When  combined  with  Task  1  and  Task  VI,  this  task  provides  data  for 
comparison  of  one-,  two-,  and  three-dimensional  compensatory  tracking  tasks  including  roll  tracking.  The 
amplitudes  of  the  individual  roll  command  frequencies  ai.  given  in  Table  '3.  In  addition  to  the  means, 
standard  deviations,  and  correlations  among  the  12  monitored  variables,  the  roll  describing  function,  roll 
remnant  analysis,  and  test  variables  derived  from  them  were  obtained  (Appendix  C). 


Table  13.  Amplitudes  of  the  Roll  Command 
Frequencies  (Task  V) 


Number  of 

Cycles  In  Run 

Frequency 

(Hi) 

Amplitude 

(degrees) 

9 

0.018 

28.72 

13 

0.025 

19.90 

J  6 

0.031 

16.16 

20 

0.039 

12.93 

25 

0.049 

10.34 

33 

0.064 

7.82 

41 

0.080 

6.30 

51 

0.100 

5.04 

63 

0.123 

4.10 

81 

0.158 

3.19 

101 

0.197 

2.56 

127 

0.248 

1.98 

161 

0.314 

1.60 

203 

0.396 

1.27 

255 

0.498 

1.01 

321 

0.627 

0.81 
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(3)  Task  VI -Roil,  Pitch,  and  Yaw  Tracking 

Task  VI  is  the  same  as  Task  I  in  both  its  requirements  of  the  6’  and  its  duration.  Sum-of-sine 
command  signals  described  in  Tables  14,  15,  and  16  were  introduced  into  the  three  axes.  It  should  be  noted 
that  this  task  was  considered  harder  by  many  5s  than  the  other  t  acking  tasks,  and  earned  it  the  nickname 
“airsick.”  In  addition  to  the  analyses  of  Task  V,  cross-frequenc;  and  remnant  analyses  were  performed  on 
the  tracking  data.  The  test  measurements  obtained  are  indicated  in  Appendix  C  by  name,  and  the 
computations  required  to  obtain  them  are  given  in  Appendix  A. 


Table  14.  Amplitudes  of  the  Roll  Command 

Frequencies  (Task  VI) 

NumMr  of 

Cycln  In  Run 

Fraquaney 

(Hz) 

Amplitude 
(dag  rats) 

9 

0.018 

14.18 

13 

0.025 

10.21 

16 

0.031 

8.29 

20 

0.039 

6.63 

25 

0.049 

5.29 

33 

0.064 

4.01 

41 

0.080 

3.23 

51 

0.100 

2.58 

63 

0.123 

2.10 

81 

0.158 

1.63 

101 

0.197 

1.31 

127 

0.248 

1.04 

161 

0.314 

0.82 

203 

0.396 

0.65 

255 

0.498 

0.52 

321 

0.627 

0.41 

Table  15.  Amplitudes  of  the  Pitch  Command 

Frequencies  (Task  VI) 

Numbar  of 

CyclM  In  Run 

Fraquancy 

(Hz) 

Amplltuda 

(degrin) 

10 

0.020 

6.55 

14 

0.027 

4.68 

17 

0.033 

3.86 

22 

0.043 

2.98 

26 

0.051 

2.52 

35 

0.068 

1.87 

43 

0.084 

1.52 

53 

0.104 

1.23 

64 

0.125 

1.02 

87 

0.170 

0.75 

111 

0.217 

0.59 

131 

0.256 

0.50 

172 

0.336 

0.38 

207 

0.404 

0.31 

273 

0.533 

0.24 

355 

0.693 

0.18 
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Table  16.  Amplitudes  of  the  Yaw  Command 
Frequencies  (Task  VI) 


Number  of 

Cycle*  In  Run 

Frequency 

(Hi) 

Amplitude 

(degree*) 

"*11 

0.021 

4.61 

15 

0.029 

3.38 

18 

0.035 

2.81 

24 

0.047 

2.11 

29 

0.057 

1.74 

37 

0.072 

1.37 

49 

0.096 

1.03 

54 

0.105 

0.94 

73 

0.143 

0.70 

95 

0.186 

0.53 

117 

0.229 

0.43 

147 

0.287 

0.3  c 

193 

0.377 

0.26 

237 

0.463 

0.21 

265 

0.518 

0.19 

347 

0.678 

0.15 

(4)  Task  VII— Reduced  Bandwidth  Roll  Trackit;^ 

This  task  is  identical  to  Task  V  in  performance  and  ^alysis  xcept  that  the  reduced  bandwidth 
command  signal  described  in  Table  17  was  substituted  for  the  one  previously  used.  Frequencies  above  0.1 
Hz  were  reduced  to  25  percent  of  the  original  amplitude.  Frequencies  of  0.1  Hz  and  lower  were  slightly 
increased  in  amplitude  to  keep  the  energy  in  the  command  signal  (mean  square)  the  same  as  that  in  the 
Task  V  command  signal. 


Table  1 7.  Reduced  Banwidth  Roll-Tracking 
Command  Signal  Amplitudes  (Task  VII) 


Number  of 

Cycle*  In  Run 

Frequency 

(Hi) 

Amplitude 

(degree*) 

9 

0.018 

29.45 

13 

0.025 

29.41 

16 

0.031 

16.58 

20 

0.039 

13.26 

25 

0.049 

10.59 

33 

0.064 

8.02 

4. 

0.080 

6.46 

51 

L  100 

5.17 

63 

0.123 

1.05 

81 

0.158 

0.81 

101 

0.197 

0.66 

127 

0.248 

0.52 

161 

0.314 

0.41 

203 

0.396 

0.32 

255 

0.498 

0.26 

321 

G.627 

0.21 
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(5)  Task  VIII -Reduced  Amplitude  Roll  Tracking 

This  task  is  identical  to  Task  V  in  performance  and  analysis.  The  command  signal  was  the  same  as 
that  given  in  Table  13  except  that  the  amplitudes  were  reduced  by  one-third  to  make  the  task  easier. 

(6)  Task  IX -Ground  Reference  Turning  Maneuver 

Task  IX  calls  for  the  5  to  fly  a  circular  path  over  the  ground  in  fuU  rough  air  while  keeping  his 
altitude  constant  at  1000  ft  and  his  airspeed  constant  at  100  mph.  The  task  was  designed  to  be  a  half¬ 
standard  turn  (360  degrees  rotation  in  four  minutes)  and  S  was  so  infomied.  S  approaches  from  the  west  on 
the  tangent  line  and  performs  one  full  turn.  Because  of  the  novelty  of  the  task,  5s  were  given  one  warm-up 
try  before  the  monitored  run.  5  called  “Mark"  when  he  met  the  circle,  at  which  time  F  started  the 
performance  monitor.  5  was  monitored  for  the  first  three  minutes  of  the  turning  task.  Unique  flight 
variables  recorded  in  this  task  were:  the  heading  deviations  from  the  heading  profile  specified  by  the 
half-standard  turn  (90°  per  minute)  and  the  radius  from  the  aircraft  (bullseye)  to  center  of  the  circle 
measured  in  feet. 

(7)  Task  X- Altitude  and  Position  Tru-king 

This  task  is  similar  to  Task  I  in  calling  for  the  5  to  hold  his  altitude  at  1000  ft  and  his  airspeed  at  100 
mph.  Instead  of  holding  a  constant  heading  as  in  Task  I,  however,  5  is  requested  to  hold  his  north-south 
position  constant  using  the  visual  reference  system.  The  sum-of-sine  command  signals  given  in  Tables  18 
and  19  were  added  into  position  and  altitude  flight  variables  to  make  this  a  two-dimensional  tracking  task. 
The  task  corresponds  to  flying  over  a  straight  line  on  the  ground  at  a  constant  altitude  under  severe  side 
winds  and  up  and  down  drafts.  This  task  introduced  two  new  compensatory  tracking  tasks:  altitude  and 
position  tracking.  Both  of  these  tracking  tasks  require  an  addition  J  degree  of  integration  on5’s  part  more 
than  the  axis  (roll,  pitch,  or  yaw)  tracking  paradigms  previously  used.  The  tasks  are,  therefore,  harder  in 
that  they  require  more  anticipation  and  planning  than  axis  tracking  Except  for  the  new  command  signals, 
the  analyses  are  the  same  as  the  two-dimensional  analysis  of  Task  I. 

Table  18.  Amplitudes  of  the  North-Soul  h  Position 
Command  Frequencies  (Task  X) 


Numbtr  of 
Cycles  In  Run 

Frtqutney 

tHz) 

Amplltudt 

(Fttt) 

2 

0.004 

213 

5 

0.010 

203 

8 

0.016 

133 

12 

0.023 

79 

14 

0.027 

67 

19 

0.037 

51 

21 

0.041 

47 

25 

0.049 

43 

Table  19.  Amplitudes  of  the  Altitude 

Command  Frequencies  (Task  X) 

Numbtr  of 

Frtqutney 

Amplitude 

Cycloi  In  Run 

(Hz) 

(F*«) 

1 

0.004 

27.7 

4 

0.010 

26.1 

7 

0.016 

14.6 

10 

0.023 

10.4 

15 

0.027 

6.9 

18 

0.037 

5.4 

23 

0.041 

3.8 

32 

0.049 

1.5 

Results 


Each  of  the  2,436  test  measurements  was  given  a  one-way  anslysis  of  variance  to  determine  its  relative 
importance  in  separating  the  three  groups.  The  distribution  of  F  values  obtained  from  these  analyses  is 
shown  in  Table  20.  The  420  variables  that  were  statistically  significant  at  the  5  percent  level  arc  listed  in 
Appendix  D,  along  with  significance  level,  group,  means,  grand  means,  and  standard  deviation  within  a 
group.  In  addition  to  this  tabular  listing,  the  420  significant  variables  have  been  marked  in  the  final  analysis 
printout  in  Appendix  C  by  arrows  so  that  they  may  be  cross-referenced  by  name  and  easily  tabulated. 


Table  20.  Distribution 
of  F  Values  for 
Experiment  2 


F  Limit* 

Significance 

Variable* 

0 

0.50 

1,024 

1.0 

372 

1.5 

219 

2.0 

198 

2.5 

0.10 

137 

3.0 

66 

3.35 

0.05 

142 

4.24 

0.025 

122 

5.49 

0.01 

61 

6.49 

0.005 

40 

7.81 

0.002 

24 

8.81 

0.001 

31 

Total 

2,436 

To  determine  which  of  the  ten  flight  tasks  contributed  more  statistically  significant  variables  and  to 
compare  new  tasks  with  the  previous  tasks,  the  breakdown  by  task  of  Table  21  was  made.  The  most 
efficient  tasks  are  Task  I  and  Task  V,  both  iequiring  roll  tracking.  The  rest  have  lower,  more  or  less  equal 
percentages,  except  for  Task  X  (altitude  and  position  tracking  with  the  visual  eference  system)  which 
stands  out  with  a  lower  percentage.  Task  IX,  the  other  task  using  the  visual  reference  system,  has  a  payoff 
in  significant  variables  similar  to  the  coordinated  turning  portions  of  Task  III  not  using  the  reference 
system.  In  general,  the  new  tasks  of  Experiment  2  identified  significant  variables  similar  to  those  identified 
in  Experiment  1 . 


Table  21.  Breakdown  of  Important  Variables 
of  Experiment  2  by  Task 


Source  of 
Variable* 

Number  of 
Available 
Variable* 

Number 
Significant 
(S%  Teit) 

Percentage 
Significant 
(S%  Te*t) 

Task  I 

240 

66 

28 

Task  11 

240 

40 

17 

Task  III 

424 

54 

13 

Task  IV 

104 

12 

12 

Task  V 

173 

52 

30 

Task  VI 

579 

89 

15 

Task  VII 

173 

34 

20 

Task  VIII 

173 

38 

22 

Task  IX 

90 

13 

14 

Task  X 

240 

22 

9 

Tota' 

2,436 

420 

30 


Hie  four  generic  types  of  measurements  made  in  Experiment  2  are  each  broken  down  into  two 
portions  in  Table  22  to  assess  the  importance  of  the  additional  test  variables  introduced  in  Experiment  2. 
The  upper  number  in  Columns  2  and  3  is  the  number  of  Experiment  1  variables  that  were  duplicated  in 
Experiment  2.  The  second  number  is  the  number  of  additional  test  variables  measured  in  Experiment  2. 
The  third  number  is  the  total  of  the  first  and  second  numbers. 


Table  22.  Breakdown  of  Important  Variables  of 
Experiment  2  by  Generic  Type 


Number  of 

Number 

Percantaga 

Sourc*  of 

Available 

Significant 

Significant 

Variable* 

Varlablai 

(5%  Te*t) 

(5%  Teit) 

Means 


Dupiiations 

44 

8 

18 

Additional 

123 

22 

18 

Total 

167 

30 

18 

Deviations 

Duplications 

44 

21 

47 

Additional 

123 

33 

27 

Total 

167 

54 

32 

Correlations 

Duplications 

102 

8 

8 

Additional 

812 

91 

11 

Total 

914 

99 

11 

Tracking 

Duplications 

128 

43 

34 

Additional 

1,060 

194 

18 

Total 

1,188 

237 

20 

Variable  totals 

2,436 

420 

The  number  of  statistically  significant  new  means  did  not  change  proportionally,  since  18  percent 
were  significant  in  each  case.  The  proportion  of  standard  deviations  and  tracking  measurements,  however, 
decreased,  and  proportion  of  correlations  increased.  Overall,  the  proportion  of  statistically  significant 
Experiment  1  variables  was  higher  (25  percer  t)  than  the  proportion  of  additional  variables  of  Experiment  2 
(16  percent). 

Because  of  the  large  number  of  flight  variables  (16),  an  important  question  to  ask  is:  Which  direct 
measurements  are  essential?  To  answer  this  qu  'stion  :.s  well  as  to  compare  new  direct  measurements  of  the 
flight  variables  (means  and  standard  deviatiors)  .v.th  the  previous  set,  the  data  of  Table  23  were  obtained 
from  Appendix  C.  The  results  in  Table  23  are  clear-cut  because  proportions  and  numbers  of  important 
direct  measurements  are  generally  either  large  or  small. 

This  data  suggests  that  the  following  flight  variables  be  deleted  from  the  experiment: 

•  Power 

•  Rudder 

•  Aileron 

•  Northing  ’ 

•  Radius 

•  Glide  Slope 

•  Left/Right  turns 

•  Heading  deviation 

On  the  whole,  the  added  flight  variables  were  not  so  important  as  the  ones  previously  used.  Only  two,  turn 
rate  and  elevator,  are  regular  contributors  of  significant  variables.  Of  these,  turn  rate  provides  the  highest 
number  of  significant  variables. 
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Table  23.  Breakdown  of  Important  Means  and  Standani 
Deviations  of  Experiment  2 


Flight  Variable 

Number  of 

Test 

Measurements 

Available 

Numb'. 
Significant 
(5%  Test) 

Percentage 
Significant 
(5%  Test) 

Turn  rate 

28 

13 

46 

Power 

28 

3 

1 1 

Rudder 

28 

1 

4 

Elevator 

28 

10 

36 

Aileron 

28 

1 

4 

Northing 

20 

0 

0 

Radius 

2 

1 

50 

Airspeed 

28 

9 

32 

Altitude 

28 

9 

32 

Fixed  reference 

20 

7 

Changing  reference 

8 

2 

Climb  rate 

28 

6 

21 

Roll 

28 

10 

36 

Pitch 

28 

9 

32 

Yaw  (heading) 

28 

11 

39 

Fixed  reference 

22 

s 

36 

Changing  reference1 

6 

3 

50 

Glide  slope 

2 

0 

o 

Left/ right  turns 

2 

0 

0 

Total  measurements 

334 

83 

aReferrcd  to  as  heading  deviations  in  the  computer  analysis  of  Appendix  C. 


With  !he  added  abillty  t0  monitor  a  changing  reference,  as  in  the  changing  altitude  and  changing  yaw 
(or  head  mg)  tasks,  14  new  measurements  were  made  in  the  flight  profile.  Five  of  these  (35  percent)  were 
statistically  significant  compared  with  36  percent  of  the  fixed  reference  altitude  and  yaw  measurements. 
This  is  judged  insufficient  evidence  to  show  that  the  changing  reference  monitoring  capability  contributed 
to  puot  performance  measurement. 

The  results  of  the  roll,  pitch,  and  yaw  cross-frequency  analyses  are  tabulated  in  Table  24  The 
denominators  of  each  fraction-like  entry  represent  the  number  of  test  variables  available  from  the  particular 
analysis  [Fourier,  mean  square  error  (MSE),  or  derived]  in  combination  with  the  particular  flight  variable  - 
command  frequency  combination.  The  numerator  of  each  fraction  is  the  number  of  available  test  variables 
that  are  statistically  significant  (5  percent  test). 

There  was  little  evidence  from  Table  24  suggesting  that  the  remnant  analyses  were  important.  The 
proportion  of  variables  accounting  for  mean  square  remnant  error,  the  variables  judged  most  important  in 
this  case,  did  not  exceed  8  percent. 

Considering  the  cross-frequency  analyses  of  Table  24  (one  flight  variable  analyzed  at  command 
frequencies  of  another  axis),  there  was  little  to  suggest  that  this  cross-analysis  is  important.  One  possibly 
mportant  combination  was  the  pitch-at-roll  combination  with  6  of  18  variables  statistically  significant.  In 
the  three  pitch-at-roll  analyses  carried  out  in  Experiment  2  however,  none  of  the  six  significant  MSE 
vanables  were  significant  more  than  once  each,  suggesting  that  the  pitch-at-roll  differences  among  groups 
are  not  repeatable.  1 

The  roll,  ptich,  and  yaw  describing  function  analyses  (roll-at-roll,  pitch -at -pitch,  and  yaw-at-yaw 
reference  in  Table  24)  were  the  most  important  tracking  analyses,  and  the  roll  describing  function  was  the 
most  important  of  these.  A  survey  of  the  seven  variables  derived  from  (or  fitted  to)  each  describing 
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Table  24.  Numbers  cf  Significant/ Available 
Test  Variables  Pooled  for  All  Roll,  Pitch, 
or  Yaw  Tracking  Tasks 


Flight  Variables 
at 

Glvan  Frequencies 

Fourlar 

Analytii 

MSE 

Analysli 

Derived 

Varlablai 

Roll  at  roll 

90/240 

15/36 

21/42 

Roll  at  pitch 

8/64 

3/18 

1/8 

Roll  at  yaw 

8/32 

0/6 

0/2 

Roll  at  remnant 

10/80 

3/36 

Pitch  at  roll 

10/64 

6/18 

1/8 

Pitch  at  pitch 

15/96 

4/18 

6/21 

Pitch  at  yaw 

1/32 

0/6 

0/2 

Pitch  at  remnant 

3/32 

0/18 

Yaw  at  roll 

4/32 

2/6 

1/2 

Yaw  at  pitch 

4/32 

0/6 

0/2 

Yaw  at  yaw 

7/48 

3/6 

2/7 

Yaw  at  remnant 

0/10 

0/6 

Table  25.  Frequently  Significant  Tracking  Measures 


Oarlvad  Tracking 

Measurements 

Number  of 

Taat 

Maaauraa 

Available 

Number 
Significant 
(5%  Teat) 

High  frequency  roll  gain 

6 

6 

High  frequency  roll  crossover 

6 

5 

Low  frequency  roll  gain 

16 

4 

Low  frequency  roll  crossover 

16 

4 

High  frequency  pitch  gain 

13 

2 

High  frequency  pitch  crossover 

13 

2 

function  showed  that  the  most  reliable  significant  variable  was  high  frequency  roil  gain.  In  the  six  roll¬ 
tracking  tasks,  the  high  frequency  roll  gain  measurement  was  statistically  significant  in  separating  the  pilot 
groups  in  all  six  tasks.  This  and  other  frequently  repeated  significant  measures  are  shown  in  Table  25 . 

These  results  suggest  that  the  roll  describing  function  is  a  very  reliable  measurement  for  measuring 
pilot  performance.  In  six  different  tracking  tasks  of  varying  difficulty  and  dimensionality,  the  high 
frequency  portion  of  the  roll  describing  function  was  always  statistically  significant. 

Table  26  breaks  down  the  results  of  the  altitude  and  position  tracking  tasks  into  three  measurement 
families  and  six  different  cross-analyses.  There  was  no  evidence  to  suggest  that  any  one  of  the  18  families  of 
test  measurements  is  useful  in  differentiating  the  groups  of  pilots.  A  probable  explanation  for  this  is  that 
the  difficulty  of  the  task  and  the  low  tracking  gains  resulted  in  highly  variable  performances. 

Table  27  shows  a  tabulation  of  the  number  of  significant  tracking  variables  in  the  single-axis  analyses 
(roll  and  roll  frequencies,  pitch  at  pitch,  and  so  on).  The  number  of  available  variables  included  those  of  the 
frequency  analysis,  mean  square  error  analysis,  and  derived  variables  (those  fitted  to  the  describing 
function).  In  comparing  Tasks  V,  I,  and  VI,  which  are  1-,  2-,  and  3-dimensional  tracking,  respectively,  it  was 
observed  that  Task  V,  1-dimensional  roll  tracking,  has  the  highest  proportion  of  its  variables  statistically 
significant. 
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Table  26.  Numbers  of  Significant/ Available 
Test  Variables  for  Position  and  Altitude 
Tracking  (Task  X) 


Flight  Variables 

at 

Givan  Frequencies 

Fourlar 

Analysis 

MSE 

Analysis 

Oerivtd 

Variablei 

Position  at  position 

1/24 

0/6 

0/7. 

Position  at  altitude 

0/16 

0/6 

0/2 

Position  at  remnant 

0/8 

0/6 

Altitude  at  position 

3/16 

0/6 

0/2 

Altitude  at  altitude 

1/24 

0/6 

0/7 

Altitude  at  remnant 

1/8 

0/6 

Totals 

6/96 

0/36 

0/18 

Table  27.  Comparison  of  Dimensionality 
and  Command  Spectrum  Based  on  All 
Single-Axis  Tracking  Analyses 

Talk 

Tracking 

Axis 

Number  of 
Available 
Variable! 

Number 
Significant 
(5%  Teit) 

Percent 
Significant 
(5%  Teit) 

I 

Roll 

37 

18 

49 

Pitch 

37 

14 

38 

II 

RoU 

37 

15 

41 

Pitch 

37 

2 

5 

V 

RoU 

59 

31 

53 

VI 

RoU 

59 

22 

37 

Pitch 

59 

9 

15 

Yaw 

59 

12 

20 

VII 

RoU 

59 

18 

31 

VIII 

RoU 

j9 

22 

37 

The  results  suggested  that  single  coordinate  roll  tracking  was  best  for  separating  the  groups  of  pilots. 
The  fact  that  single-axis  roll  tracking  discriminated  among  groups  contradicted  the  results  of  Krendel  and 
McRuer  (1960)  who  found  that  single-axis  tracking  did  not  discriminate  among  pilot  skills.  The  explanation 
for  this  discrepancy  probably  lies  in  the  different  test  environments.  The  “job  sample”  approach  using  the 
GAT-1  may  have  measured  differences  in  skill  levels,  whereas  the  “bench-top”  tests  using  joystick  and 
display  may  not  have  provided  a  suitable  test  environment. 

Using  Table  27  to  compare  the  three  types  of  command  signals  used  in  the  single-coordinate,  roll¬ 
tracking  tasks  (Tasks  V,  VII,  and  VIII),  it  can  be  seen  that  the  normal  roll-tracking  command  signal  (Task 
V)  had  the  highest  proportion  of  statistically  significant  test  variables.  The  lower  proportion  (31  percent)  of 
significant  variables  with  reduced  bandwidth  roll  tracking  than  with  standard  roll  tracking  (53  percent) 
suggested  greater  higher  frequency  amplitudes  would  be  better  in  differentiating  the  three  groups.  The 
lower  proportion  of  significant  variables  (37  percent)  in  reduced  amplitude  roll  tracking  than  in  standard 
roll  tracking  (53  percent)  furnished  further  evidence  in  favor  of  this  uterpretation. 


V.  APPLICATION  OF  DISCRIMINANTS  TO  EXPERIMENT  2  DATA 

Results 

To  determine  how  well  the  three  discriminants  obtained  from  the  data  of  Experiment  1  separated  the 
three  groups  ol  5s  in  Experiment  2,  the  three  discriminants  (AM,  MM,  and  RAM)  were  applied  to 
Experiment  2  data.  Measurements  of  the  first  and  second  canonical  variables  were  obtained  for  each  5  using 
Eqs.  (1)  and  (2)  with  the  weights  given  in  Tables  8,  10,  and  12,  and  the  measurements  of  test  variables 
obtained  from  30  new  5s  for  the  three  discriminants  are  shown  in  Figures  9, 1 0,  and  1 1  The  decision  lines5 
for  separating  the  three  groups  are  the  same  as  sown  earlier  in  the  corresponding  plots  from  Experiment  1 . 
(Figures  3, 4,  and  6.). 


SA-1676-8 

FIGURE  9  CLUSTER  PLOT  OF  THE  AM  DISCRIMINANT  APPLIED 
TO  THE  30  SUBJECTS  OF  EXPERIMENT  2 


5  Sometimes  called  decision  planes,  a  yshaped  group  of  three  radia*  lines  in  this  case. 


SECOND  CANONICAL  VARIABLE  —  quadfatic  trend 


FIGURE  10  CLUSTER  PLOT  OF  THE  MM  DISCRIMINANT  APPLIED 
TO  THE  30  SUBJECTS  OF  EXPERIMENT  2 


SECOND  CANONICAL  VARIABLE  —  quadratic  trend 


FIGURE  11 


CLUSTER  PLOT  OF  THE  RAM  DISCRIMINANT  APPLIED 
TO  THE  30  SUBJECTS  OF  EXPERIMENT  2 
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It  is  obvious  from  these  plots  that  the  three  groups  are  more  dispersed  and  overlap  considerably  more 
than  when  the  discriminants  were  applied  to  the  data  from  which  they  were  derived  (Figures  3, 4,  and  6). 
The  three  new  cluster  plots  suggest  that  the  second  canonical  variable,  accounting  for  the  quadratic 
separation  between  the  three  groups,  did  not  appear  to  influence  the  separation  of  the  new  pBots.  The  plots 
suggested  that  only  the  first  canonical  variable,  accounting  for  the  linear  separation  of  the  three  groups,  was 
meaningful.  Such  a  linear  separation  could  be  made  by  constructing  vertical  decision  lines  for  separating  the 
three  groups  on  Figures  9,  10,  and  1 1 

To  determine  how  well  the  three  discriminants  separate  the  5s  of  Experiment  2,  the  classification 
matrices  for  each  discriminant  were  obtained  and  are  shown  in  Table  28.  The  number  of  5s  from 
Experiment  2  (B,  I,  and  A  identified  on  left  of  the  matrices)  that  fell  into  each  classification  determined  by 
the  5s  from  Experiment  1  (B,  I,  and  A  identified  on  top  of  the  matrices)  are  shown. 


Table  28.  Classifications  of  Experiment  2  Subjects  Using  Discriminants 
Generated  Using  Experiment  1  Data 


AM  Classification 

Experiment  1 


B 

I 

A 

B 

8 

1 

1 

Experiment  2 

9 

0 

1 

A 

1 

2 

7 

MM  Classification 

Experiment  1 

B 

I 

A 

B 

2 

6 

2 

Experiments  I 

0 

7 

3 

A 

0 

3 

7 

RAM  Classification 

Experiment  1 


B 

I 

A 

B 

6 

1 

A 

3 

Experiment  2  1 

4 

6 

0 

A 

1 

1 

8 
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The  AM  classification  [chi-square  (6)  =  30.60,  p  <  .001] ,  the  MM  classification  [chi-square  (6)  = 
18.00,  p  <  .01  ] ,  and  the  RAM  classification  [chi-square  (6)  =  19.2,  p  <  .005]  are  all  significantly  different 
from  a  random  classification.  Since  all  three  are  significantly  different  from  a  random  classification,  how 
well  each  discriminant  identified  the  new  5s  may  be  determined  by  inspecting  the  numbers  of  5s  identified 
correctly  to  group  by  the  three  discriminants  as  follows: 

•  AM  classification  -  15  (50%) 

•  MM  classification  -  1 6  (53%) 

•  RAM  classification  -  20  (67%) 

which  suggests  that  the  RAM  discriminant  did  the  better  job.  Statistically,  however,  there  is  insufficient 
evidence  [chi-square  (2)  =  1.90,  p  <  .05]  to  show  that  the  three  discriminants  were  significantly  different 
in  their  ability  to  classify  Ss  correctly. 

Discussion 

Although  there  is  insufficient  evidence  to  show  statistically  significant  differences  in  the 
classifications  of  the  AM,  MM,  and  RAM  discriminants,  other  evidence  suggests  that  the  AM  and  MM 
discriminants  are  equally  poor  in  discriminating  Ss’  abilities  and  that  the  RAM  discriminant  is  considerably 
better  and  typifies  the  best  tha*  can  be  done. 

The  evidence  is  based  on  the  perfect  discrimination  of  AM  and  MM  on  Experiment  1  data  and  the 
poor  discrimination  on  Experiment  2  data,  compared  with  the  nearly  identical  RAM  discrimination  in  both 
experiments.  It  is  also  based  on  the  F’s  subjective  observations  of  the  5s’  abilities  and  rank  orderings  of  5s’ 
scores  in  several  test  variables. 

An  interesting  result  of  the  multivariate  analyses  was  that  the  AM  and  MM  discriminants  based  on  8 
and  15  variables  actually  classified  fewer  pilots  correctly  than  the  RAM  discriminant,  which  is  based  on 
only  2  variables.  This  finding  emphasizes  the  concern  expressed  previously  that  the  stepwise  multivariate 
discriminant  analysis,  when  used  as  a  tool  to  select  "mong  a  large  number  of  variables,  will  construct  a 
discriminant  from  variables  that  optimize  the  separation  of  the  three  groups  using  unreproducible 
peculiarities  of  the  test  variables  in  the  same  way  random  variables  are  used. 

Although  the  multivariate  analysis  procedure  is  set  up  to  select  variables  and  adjust  their  weights  to 
separate  the  pilots  into  three  groups,  there  is  evidence  that  this  is  not  possible  nor  desirable.  In  several 
instances,  the  experimenter  observed  that  a  pilot  qualifying  for  the  I  group  performed  either  like  a  B  or  an 
A  group  candidate.  Some  of  the  A  group  were  subjectively  judged  to  be  performing  as  I  group  members. 
Consequently,  the  records  of  an  I  group  subject  who  performed  like  a  B  group  subject  was  examined  more 
closely.  His  test  score  on  one  significant  variable  after  another  was  compared  to  the  three  group  means.  It 
was  found  that  his  scores  were  typical  of  the  average  B  candidate.  Forcing  the  multivariate  analysis  to 
classify  such  an  5  into  his  proper  experience  group  by  selective  weighting  of  the  performance  measures 
would  result  in  a  useless  discriminant.  Such  a  discriminant  would  force  a  5  into  an  experience  group  in 
which  he  did  not  belong,  and  therefore  would  be  based  on  somet  ring  other  than  his  skill,  as  indicated  by 
flight  hours. 

Another  indication  of  high  degree  of  rank  ordering  in  the  data  comes  from  the  multivariate 
discriminant  analysis  of  the  RAM  variables.  After  two  of  the  set  14  variables  entered  into  the  analysis  were 
selected,  the  F-to-enter  for  the  remaining  12  dropped  to  low  levels.  Thus,  all  the  remaining  variables  were 
highly  correlated  with  the  first  two  and  did  not  improve  the  separation  into  groups.  When  the  analysis 
program  was  forced  to  build  a  discriminanat  from  all  the  variables  by  making  the  F-to-enter  equal  to  zero, 
the  program  balked,  dropped  variables  one  after  the  other  because  they  failed  the  tolerance  test.  The  data, 
essentially  a  set  of  14  equations  in  30  unknowns,  produced  a  singular  solution  because  each  of  the  14 
equations  was  nearly  the  same.  A  linear  combination  of  these  14  most  significant  and  highly  correlated 
variables  would  be  an  excellent  and  stable  measure  of  performance,  but  the  multivariate  analysis  cannot 
construct  such  a  combination. 

This  is  probably  the  reason  the  RAM  discriminant,  composed  on  only  two  test  variables,  was  the  most 
successful.  The  ordering  of  the  30  5s  of  Experiment  1  (shown  previously  in  Figure  6)  along  the  axis  of  the 
linear  canonical  variable  is  probably  the  correct  ranking  of  the  5s’  skill  levels.  This  may  be  the  best 
categorization  that  can  be  made.  Whereas  the  other  discriminants,  including  the  discriminant  based  on 
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random  numbers,  classified  all  30  of  the  5s  correctly,  the  RAM  discriminant  classified  only  19  of  them 
correcUy  The  similar  ability  of  the  RAM  discriminant  to  classify  5s  from  Experiment  2  (20  correctly 
classified)  further  suggests  that  this  is  the  best  that  can  be  done:  the  variable  skill  levels  of  5s  in  each  group 

limit  the  ability  of  performance  measures  to  distinguish  among  groups. 

Conclusions 

• 

This  research  effort  assumed  that  the  number  of  hours  of  flying  experience  a  pilot  has  logged 
represents  a  defensible  measure  of  his  flying  skill.  The  Federal  Aviation  Administration’s  qualification 
cntena  for  certification  eligibility  supports  this  assumption  in  its  requirement  for  increased  numbers  of 

ornwth^  e*perien.ce  for  ^  hi&er  leve!s  of  P»lot  ratings.  Furthermore,  the  common  notion  of  skill 
growth  as  a  function  of  experience  suggests  that  the  assumption  that  pilot  skill  may  be  represented  by 
hours  of  flying  time  is  reasonable.  y  y 

.  .  pormin8  groups  of  subjects  based  on  different  levels  of  flying  experience  in  order  tc  determine  if 
-  H8  perfor™nce  measurements  could  be  used  to  categorize  the  subjects  into  their  appropriate 

E  skUI  WUh  hK  naS  WHranten  based  °?  the  aSSUmption  of  the  Nation  of  flying  experience  to 
tlying  skill.  With  this  in  mind,  a  flying  performance  measurement  system  was  conceived  in  which 

T  °f  T  a  parametersand  derived  variables  bas^d  on  them  would  indicate  the  skill  level  of 
the  pflot  who  produced  the  measured  performance.  Presumably,  the  measured  performance  characteristics 
would  permit  designation  of  the  hours  of  flying  experience,  that  is,  flying  skill  the  performance 

Si  and  vtewLP  t  100  h°UrS  Wh°  %S  the  aV6rage  150hour  p0ot  *ould  be  abo*e  average  in 

This  study  sought  to  evaluate  by  means  of  a  cross  validation  test  the  results  of  earlier  research  which 
demonstrated  that  measured  aircraft  parameters  could  be  combined  to  classify  accurately  the’  flying 
P  °f/he  °tS  Wuh°  Produced  them-  The  classification  equations  were  generated  by  a  multiple 

Experiment*  pYS  S  co"lbmatlon  with  other  statistical  and  procedural  techniques  applied  to  the  data  of 
differed  subjecb.XPenmen  2  Pr°V'ded  “  additional  861  of  near|y  identical  performance  measures  of 

have  be7nhnd5CfminantStiderired.cfr0T  th<!  SUbjeCt’S  Performance  measurements  of  Experiment  1  could 
ave  b.en  used  to  correctly  classify  the  subjects  performance  measurements  of  Experiment  2,  then  the 

Sk?  |a"d  the,proceduries  employed  would  have  been  confirmed  and  further  development  of  the 
statistical  approach  o  the  development  of  a  pflot  performance  measurement  system  applying  the  concept 
and  procedures  would  have  been  warranted.  The  results  of  the  cross  validation  accomplished  in  ExperSt 
warranted.*’  d'SCOnfirmed  the  concept  and  Procedures  tested  and  suggested  that  further  refinementwas  not 

The  most  important  outcome  of  this  research  was  not  that  discriminants  derived  from  one  set  of 

fhatrnnLTTeS  Te  T  perfect,y  accurate  When  USed  ,0  classify  new  performance  measles  bPt 
hat  the  proliferation  of  performance  measures  decreased  rather  than  increased  the  efficiency  of  the 

rat  V3nable  SkiU  ‘evels  °f  Subjects  in  each  &ouP  ,imi‘ed  the  ability  of  performance 
measures  to  distinguish  among  groups.  This  finding  is  interpreted  as  indicating  that  the  idea  of  using 

combinations  of  measures  selected  from  among  a  large  number  of  aircraft  attitude,  or  state  variables  to 

nre^nf  *  "““T*  °f.the uskili  °f  the  pilot  who  controls  1116  aircraft  using  the  procedures  employed  in  the 
present  research,  and  the  idea  of  relating  pilot  skill  to  hours  of  flying  experience  for  ouroois  of 

establishing  face  validity  of  a  measurement  system  are  not  viable  and  should  not  be  pursued  further 

Considering  only  these  essentially  negative  conclusions  based  on  the  data  it  would  be  easv  to 
overlook  the  systematic  strength  of  the  research.  The  outcome  of  this  study  has  been  intemre?S  to 
■"d*i!  that. the  ,StatB!'cal  approach  cannot  be  applied  in  the  development  of  a  practical  pilot  performance 
measurement  system.  It  is  rarely  the  case  where  research  results  serve  to  demonstrate  convincingly  the 
CfiS  of  th,e  conc®p‘  underlying  the  procedures,  apparatus  and  materials  used.  The  answer  provided 
by  this  study  is  clear  and  the  virtue  of  the  work  is  defined  by  the  clarity  of  the  negative  conclusion 


would  I**™  be'^otrexpTrfm^^0"  **  C*n0niCil  ”****  W0U,d  haV£  ™£d  **  to  20  ,or  1  and 
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APPENDIX  A.  COMPUTER  PROCESSING  OF  THE  GAT-1  DATA 


Computation  of  Test  Variab'es  for  Experiment  1 

The  L1NC-8  computer  accumulated  36-bit  (triple-precision)  sums  of  the  input  numbers 

64  RT1M 

Sk=  2  INPUT  k(i) 
i  =  1 


and  36-bit  sums  of  the  input  cross-products 

64  RTIM 

Pjk=  2  INPUT  j(i)  INPUT  k(i), 
i  =  1 

where  k  (1  <  k  <  8)  and  j  (1<  j  <  k)  were  channel  numbers,  and  64  RTIM  was  the  total  number  of  1/1 5-s 
steps  taken  in  a  given  test  run.  The  computer  generated  up  to  eight  sums-of-sines  command  signals  of  the 
form 


8  /  27r  Fy 

Ck0)=  2  Ay  sin [ - 

/=1  \  64  RTIM 

where  Ak(  was  the  amplitude  coefficient  for  the  kth  command  signal  (all  equal  in  this  case),  Fy  was  the 
frequency  for  the  k£  command  signal,  and  the  sine  function  was  approximated  by  a  function  table  having 
64  entries. 

Whde  a  monitoring  run  was  in  progress,  the  computer  saved  all  the  input  numbers,  INPUTk(i),  on  a 
disk  scratch  file  to  obtain  Fourier  sums  at  the  command  signal  frequencies  after  the  test  run  had  been 
completed.  The  Fourier  sums  for  each  channel,  k,  and  at  each  command  frequency,  Fy  were: 


64  RTIM  /  2n  Fy  \ 

Ay  =  2  sin  f - d  lNPUTk  (i) 

i=l  ^  64  RTIM  J 

64  RTIM  /  2rr  Fy  \ 

Bkl  =  £  — - *  J  INPUTk(i) 

i  =  1  \64  RTIM  / 

These  data  on  punched  tape  served  as  the  input  for  a  second  computer  program  that  provided  the 
usable  output.  This  FORTRAN  program  first  converted  the  numbers  into  the  correct  units  by  multiplying 
by  the  correct  scale  factor.  The  means  and  standard  deviations  were  computed  from  the  scaled  sums, 
products,  and  Fourier  coefficients  as  follows: 


MEANk  =  Sk 
SDk  =/Pkk  ~  sk2 

The  between-signal  correlation  <*fficients,  rjk,  were 
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To  calculate  an  S  gain  and  phase  shift  at  each  of  the  command  signal  frequencies,  both  the  error  signal  and 
the  response  signal  amplitude  phase  must  be  known.  The  error  components,  Ek;  are 

|EklJ  =V^k/  +  Bkf 

j[j  =  t®n 

To  obtain  these  compoenents  for  the  S' s  response,  Rk;,  the  command  signal,  must  be  known.  The 
command  amplitudes  were  measured  and  built  into  the  FORTRAN  analysis  program.  By  using  the 
command  amplitude,  Ck<,  the  response  was  calculated  by  the  complex  number  subtraction 


Rk/  =  Ckf  Ek/> 


and  the  magnitude  and  phase  of  RkJ  were  computed  in  the  same  way  that  they  were  computed  for  Ekj. 
Finally,  the  gain  and  phase  shift  of  the  S  at  each  command  frequency  were  calculated  and  printed  out: 


kil 

GAlNk)  = - p 

h, 


PHASEk, 


The  gain  in  decibels  was  determined  by  the  formula 


GAIN  (dB)k,  =  201og10GAINkJ 

The  gain  and  phase  shift  plotted  as  a  function  of  frequency  became  the  “Pilot-Vehicle  Describing 
Function”  of  McRuer  et  al.,  (1965).  From  this  describing  function,  several  derived  measurements  were 
obtained.  The  gains  and  pha'es  from  the  higher  and  lower  half  of  the  frequencies7  were  averaged  together 
to  produce  the  “Hi”  and  “Fxjw”  frequency  gain  and  “Hi”  and  “Low”  frequency  phase  listed  in  Appendix 
B.  Figure  A-l  illustrates  how  the  other  three  derived  parameters  were  obtained  by  least-mean-square  fitting 
straight  lines  to  the  four  higher  and  lower  frequency  gains  and  determining  the  intercept  frequency  at  zero 
Hz.  The  equivalent  time  delay  was  obtained  by  a  least-mean-square  fit  of  the  model,  e'5t,  to  the  higher 
frequency  phase  shifts  to  estimating  the  operator  time  delay  parameter,  t,  of  the  McRuer  et  al.,  (1965) 
Simple  Crossover  Model. 

Additional  Test  Variables  for  Experiment  2 

The  variables  based  on  means,  standard  deviations,  correlation  coefficents,  and  the  describing 
function  of  Experiment  2  were  computed  as  described  for  Experiment  1.  Additional  analyses  added  in 
Experiment  2  were  the  cross-frequency  and  iemnant  analyses.  Both  of  these  required  the  Fourier  analysis 
of  a  flight  variable  at  different  sets  of  frequencies  instead  of  just  one  set.  The  procedure  and  formulation 
used  have  already  been  described  in  the  first  part  of  this  appendix. 

7 The  4  highest  and  lowest  frequencies  when  8  are  used,  and  the  8  highest  and  8  lowest  frequencies  when  16  are  used. 


AMPLITUDE  RATIO  —  dagraa/dagra* 


SOURCE: 


Graph!  from  F.  o.  Nawall,  Human  Transfer  Characteristics  in  Flight  and  Ground  Simulation  for 
the  Roll -Tracking  Task,  AFFDL-TR-67-30,  April  1968. 
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FIGURE  A-1  Y  Y  WITH  CONTROLLED  ELEMENT  K/s 


AMPLITUDE  RATIO 
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In  the  cross-frequency  analysis,  the  Fourier  sine  and  cosine  coefficients,  Ake  and  Bk e  for  the  k1’1 
flight  variable  were  obtained  and  analyzed  at  the  command  frequencies  of  some  other  flight  variable  (the 
mth).  The  isolation  in  decibels  and  the  phase  shift  in  degrees  were  calculated  as  follows: 

(\t  2  +  B2ke 

ISOLATION^  =  10  o  - 

V  C2 

'  me 

PHASE,,,  ■  tan  ’  (A,,/^,) 

In  the  remnant  analysis,  the  Fourier  sine  and  cosine  coefficiei  ts  Akc  and  Bkt.  for  the  kth  flight 
variable  were  analyzed  at  the  remnant  frequencies.  These  are  a  set  of  frequencies  different  from  those  of  any 
other  command  signal.  The  amplitude  of  the  remnant,  relative  to  the  total  power  in  the  kth  variable,  was 

Amplitudekc  =  10  log1Q  1 - 

a* 

In  addition,  the  mean  square  error  accountered  for  the  kth  variable  by  the  frequencies  of  the  m1’’ 
variable  was  computed  by  summing  16  terms: 


16 

MSE  accounted  for  =  S  Akc2  +  Bke2 
e  =  1 

The  high  and  low  frequency  portions  were  computed  from  the  first  8  and  second  8  of  this  sum. 

Taken  together,  the  MSE  accounted  for  by  the  command  signal  input  to  the  flight  variable  itself  and 
the  command  signals  input  to  other  flight  variables  can  be  put  in  the  form8  shown  as  follows: 


Roll  Axis 
Pitch  Axis 
Yaw  Axis 


MSE  ACCOUNTED  FOR  BY 


Total 

Roll 

Fitcn 

Yaw 

Remnant 

MSE 

Frequency 

Frequency 

Frequency 

Frequency 

164.82 

18.19 

9.99 

80.70 

8.02 

7.67 

.79 

2.78 

.46 

.44 

14.08 

1.47 

1.45 

5.57 

1.07 

These  data  are  the  cross-coupling  of  the  command  inputs  from  one  flight  variable  to  another  caused 
by  the  S.  When  cross-coupling  MSE  is  substantially  grater  than  the  remnant  MSE  (a  random  set  of 
frequencies),  the  excess  can  be  attributed  to  S. 

In  addition  to  this  basic  cross-coupling  matrix,  the  coefficients  of  a  high  frequency  and  low  frequency 
cross-coupling  matrices  (based  only  on  the  upper  and  lower  eight  frequencies)  were  computed.  Also,  data 
for  three  normalized  cross-coupling  matrices  (total,  high  frequency,  and  low  frequency)  were  obtained  from 
these  three  matrices  by  dividing  each  entry  by  the  total  MSE  for  its  axis.  In  total,  data  for  six  different 
cross-coupling  matrices  were  computed  and  printed  for  the  two  and  three-dimensional  tracking  analyses. 


7  The  4  highest  and  4  lowest  frequencies  when  8  are  used,  and  the  8  highest  and  8  lowest  frequencies  when  16  are 

used. 

8  Numbers  are  taken  from  the  roll,  pitch,  and  yaw  data  of  Appendix  C.  Units  arc  degrees  squared.  The  three  by -three 
array  in  the  center  is  defined  as  the  cross-coupling  matrix. 
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APPENDIX  B.  FINAL  PRINTOUT  OF  326  PARAMETERS 
MEASURED  ON  ONE  SUBJECT  IN  EXPERIMENT  1 


Variables  significant  at  the  5-percent  level  are  marked  by  arrows, on  the  printouts  that  follow. 


47 


ZtIDLER.  ADVANCED 
ROLL  AND  PITCH  TRACKING 


VARIABLE 


•  • MEAN#  t  • 

•  *so* •  •  • 

UNITS 

AIRSPEED 

105.76 

2.89 

MPH 

ALTITUDE 

978.53 

25.31 

FEET 

CLIMB  RATE 

20.25 

108.76 

FT/MIn 

roll 

-.22 

1.85 

DEGREES 

PITCH 

3.60 

2.03 

DEGREES 

YArf 

.02 

1  •  86 

DEGREES 

1  7 

2  a 

3  9 
A  10 

5  U 

6  12 


CORRELATION  COEFFICIENTS.  R(I.J) 


-.398 

-.591  .232 

.262  —.085  -.140 

-.212  -.153  .2*9  .062* 

.252  -,0T7  -.133  .995  .06*4 


13 

1*  15 

16  17 

19  20 

23  2* 


ROU  ANALYZEO  AT  THE  ROLL  FREQUENCIES 


FREQ 

gain 

GAIN 

(HZ) 

(OB) 

•002 

125.032 

*1.9* 

•  010 

*4.767  4 

33.024 

•029 

13.233 

22.43 

•  037 

4.935 

13.87 v 

.123 

1.6064 

4. Ill 

•  191 

1.0634 

•  534 

.307 

.6334 

-3.974 

.467 

k'  AAi 

.429  4 

-7.354 

PHASE 

(DEG) 

-275.3* 

-183.66 

•154.67 

-139.4* 

-129.29 

-134.02 

•161.26 

-197.61 


HEAN  SQUARE  ERROR  ACCOUNTED  FOR 
HE AN  SQUARE  RESPONSE  ACCOUNTFO  FOR 
10*  FREQUENCY  GAIN  27. si  08 

LO*  FREQUENCY  CROSSOVER  .39  MZ 

L03  FREQUENCY  Phase  -188.28  DEGREES 

Hi  FREQUENCY  GAIN  -l!feT40B 

HI  FREQUENCY  CROSSOVER  m?n  HZ 

Hi  FREQUENCY  PHASE  -155.5*  DEGREES 

equivalent  TIRE  delay  ,M  SECONOS 


7291.19  OEG*OtG 
.41  OEG*DbG 
7258.42  OEG»d£g 


31 

32 

33 
3* 

35 

36 

37 

38 
30 
28 
29 

275 

276 

277 

278 

279 

280 
281 


267 

268 

269 

270 

271 

272 

273 

274 


PITCH  ANALYZEO  AT  THE  PITCH  FREQUENCIES 


7REO 

(HZ) 

GAIN 

GAIN 

(08) 

PHASE 

(OEG) 

•  004 

59.169 

35.44 

-26a. 45 

.014 

22,083 

26,88 

-240.83 

•  027 

16.120 

24.15 

•202.28 

•  033 

3.290 

10.34 

•160.50 

•  115 

1.663 

4.42 

-130.45 

•  158 

.996 

-.0* 

-150.21 

•  283 

.517 

-5,73 

-145,85 

•535  .363 

MEAN  square  forcing 

-8.79 

FUNCTION 

-177.52 

MEAN  SQUARE  ERROR  ACCOUNTED  FOR 
HEAN  SQUARE  RESPONSE  ACCOUNTEO  FOR 
LO*  FREQUENCY  GAIN 
LO*  FREQUENCY  CROSSOVER 
LO*  FREQUENCY  PHASE 
Hi  FREQUENCY  GAIN 
HI  FREQUENCY  CROSSOVER 
Hi  FREQUENCY  PHASE 
EQUIVALENT  tine  DELAY 


24.20 

08 

.25 

HZ 

-218,01 

DEGREES 

-2.54 

08 

.17 

HZ 

-156,01 

degrees 

.54 

SECONOS 

468.99  OEG*Db( 
.92  OEG*Ott 
*80,05  0EG»Ut( 


50 

51 

52 

53 
5* 

55 

56 


57 

*9 
♦  7 


*8 

305 


306 

307 

308 

309 


310 

311 


297 

298 

299 

300 

301 

302 

303 
104 


NUMBFRS 


18 

21 

25 


39 

40 
*i 

42 

43 

44 
*5 
46 


58 

59 

60 

61 

62 

63 

64 

65 


zt idles <  aovanceo 

variable 

NUMBERS 

HULL  ANO  PITCH  TRACKING  KITH  POKE«  CHANGES 

•  8  • • #  *UNI TS 

AIRSPEED  101.3* 

9.79  MPH 

66 

72 

ALTI TUOE  987.  T3 

25.05  FEET 

67 

73 

CLIMB  RATE  16. SO 

118.45  FT/M1N 

68 

74 

ROLL  -1.82 

2.174  DEGREES 

69 

75 

PITCH  A. 18 

2.19  DEGREES 

70 

76 

Y*K  -1.57 

2.174  DEGREES 

71 

77 

CORRELATION  COEFFICIENTS.  H  < I i J) 

-.131 

78 

-.130  ,2*8 

79 

80 

.100  -.218  -.172 

81 

82 

83 

-.562  -.113  .300 

.080 

84 

85 

86 

.099  -.216  -.169 

.997  .084 

88 

89 

90 

ROLL  ANALYZEO  AT  THE 

ROLL  FREQUENCIES 

FREQ  GAIN 

GAIN  PHASE 

(HZ) 

(OB)  <OEG> 

•002  292.4*8 

49.32  -276.91 

96 

282 

104 

.010  12.490 

21,93  -67.23 

97 

283 

105 

.029  10.0354 

20.034  -1*1.19 

98 

284 

106 

.0S7  7.98* 

18.0*  -144.17 

99 

285 

107 

.125  1.5114 

3.594  -141.91 

100 

286 

108 

•  191  .9164 

-.764  -144,19 

101 

287 

109 

•  307  .6394 

-3.904  -156.56 

102 

2R8 

110 

.467  .471 

-6.54  -185,28 

103 

289 

111 

MbAN  SQUARE  forcing 

FUNCTION 

7291.19 

OEG*OtG 

95 

MEAN  SQUARE  ERROR  ACCOUNTED  FOR 

.61 

0EG*uta 

93 

MEAN  SQUARE  RESPONSE 

ACCOUNTED  FOR 

7290.98 

DEG*UbG 

94 

LOK  FREQUENCY  GAIN 

27.33418 

290 

LOK  FREQUENCY  CROSSOVER  .*6 

HZ 

291 

LOK  FREQUENCY  PHASE 

-157. 3B 

DEGREES 

292 

Hi  FREQUENCY  GAIN 

-1.90458 

293 

Hi  FREQUENCY  CROSSOVER  .19«HZ 

29* 

Hi  FREQUENCY  phase 

-156,98 

degrees 

295 

EQUIVALENT  TIME  DELAY  .62 

SECONDS 

296 

PITCH  ANALYZED  AT  THE  PITCH  FREQUENCIES 

FREQ  GAIN 

GAIN  PHASE 

(HZ) 

(00)  (DEG) 

.00*  15.695 

23.92  -22.28 

115 

312 

123 

.014  12.531 

21.96  -178,85 

116 

313 

12* 

.027  9.265 

19.34  -110.60 

117 

31* 

125 

•053  2.475 

7.87  -125.06 

118 

315 

126 

.115  1,712 

4.67  -124.82 

119 

316 

127 

•158  1.11* 

.9*  -132.65 

120 

31  > 

128 

.283  .436 

-7.21  -153.33 

121 

318 

129 

.535  .320 

-9,90  -191,34 

122 

319 

130 

MEAN  SQUARE  FORCING 

function 

468.99 

DEG*0tG 

114 

MEAN  SQUARE  ERROR  ACCOUNTED  FOR 

1.54 

OEG'OtG 

112 

MEAN  SQUARE  RESPONSE  ACCOUNTED  FOR 

453,94 

0EG*0LG 

113 

LOK  FREQUENCY  GAIN 

18.27 

08 

320 

LOK  FREQUENCY  CROSSOVER  .45 

HZ 

321 

lok  frequency  phase 

-109.2045EOREES 

322 

Hi  FREQUENCY  gain 

-2,87 

08 

323 

Hi  FREQUENCY  CROSSOVER  .17 

HZ 

324 

Hi  frequency  phase 

-150.54 

OEGREES 

325 

EQUIVALENT  time  OELAY  .57 

SECONDS 

326 
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Zt IDLER.  ADVANCED  VARIABLE  NUMBERS 

lOOO-FOOT  CLIMB 


AIRSPEED 
CLIMB  RATE 


.MEAN . SD...  .UNITS 

95.0V  6.11  MPH 

*02.254  105.95  FT/MIn 


131  135 


ROLL 

-1.35 

2.124  DEGREES 

133 

138 

PITCH 

8.20 

1.86  DEGREES 

13* 

139 

YAW 

-1.06 

2.1*4  DEGREES 

135 

1*0 

CORRELATION  COEFFICIENTS.  R(I.J) 

-.555 

1*1 

-.707 

.227 

1*2 

1*3 

-.*83 

.515  .*59 

U* 

1*5 

-.703 

.226  1.001 

.**7 

1*7 

1*8 

1*6 

1*9  ISO 


ZcIOLER.  ADVANCED  VARIABLE  NUMBERS 

LEVEL  360  TURN 


MEAN .....SO. ...UNITS 


AIRSPEED  109.86 

*.684  MPH 

151 

156 

ALTITUDE  1***.79 

*1.37  FEET 

15? 

157 

CLIMB  RATE  -15.00 

160.024  ET/MIn 

153 

158 

ROLL  6.93 

26.73  DEGREES 

15* 

159 

PITCH  2.85 

2.064  DEGREES 

155 

160 

CORRELATION  COEFFICIENTS.  R(I.J) 

-.61* 

161 

-.571  .17* 

162 

163 

.*56  -.039  -.337 

16* 

165 

166 

-.239  -.253  .639 

-.280 

167 

168 

169  170 

zeidler?  AOVANCEO  variable  numbers 

SLOW  FLIGHT 


AIRSPEED 
ALTITUDE 
CLIMB  RATE 

roll 

PITCH 

YAW 


. ME  AN. ....SD.... UNITS 
79.5*  5.*04MPH 

1*33.594  36. *3  FEET 
8.754 118.97  FT/MlN 
3.11  1.70  DEGREES 

7.33  1.5*4  DEGREES 

3.*0  1.73  DEGREES 


CORRELATION  COEFFICIENTS.  R(I»J> 


165 

0124 

.17* 

386 

-.0*1 

.*5* 

2*64 

-.117 

.750 

.256 

375 

-.0*3 

,*50 

.995 

171 

177 

172 

178 

173 

179 

17* 

180 

175 

161 

176 

182 

163 

18* 

185 

166 

167 

166 

189 

190 

191 

192 

193 

19* 

195 

196 

50 


4 


197 


uiklk  JMa.,uK'.blA..1..kl^u<,  1. 


ZEIOLER.  ADVANCED 
DESCENDING  360  TURN 


VARIABLE  NUMBERS 


AIRSPEED 
CLIMB  RATE 
HULL 
PITCH 


MEAN*  *...SD**,. UNITS 
80,90  4.63  MPH 

405*004  96.534  ET/M1n 
-16.3J  20.0?  DEGREES 

2.41  1.884  DEGREES 


198  202 

199  ?03 

ZOO  20* 
Z01  ?05 


CORRELATION  C0EEF1CIENTS.  R(I.J) 

206 

Z07  208 

209  210  211 


-.3*14 
-.2T8  ,1*T 

-.0*54  .5804 -,333 


ZEIOLER.  ADVANCED  VARIABLE  NUMBERS 

500-E00T  DESCENT 


AIRSPEED 
CLIMB  RATE 

poll 

PITCH 

YAH 


mean . SO. ...UNITS 

7*. 79  3.88  MPH 

195.504  68.28  FT/MIN 

-3.67  4.53  DEGREES 

.17  2.4o  DEGREES 

-3. *8  4.55  DEGREES 


212  217 

213  218 

214  219 

215  220 

216  221 


CORRELATION  COEFFICIENTS.  R(I.J) 


-.681 

.611  -,*35 

-.773  .620  -.*86 

.610  -.*40  ,998  -.486 


222 

223  22* 

225  226  227 

228  229  230  231 


ZEIOLER.  AOVANCEO  VARIABLE  NUMBERS 

ILS  LANDING  APPROACH 


AIRSPEED 
CLIMB  RATE 
ROLL 
PITCH 

YAK 

GLIOESLOPE 

L/R 


MEAN . .  .UNITS 

98.00  7,28  MPH 

268,75  1*7.87  FT/MIn 

-11,02  3i7*4  DEGREES 

2.85  2,25  DEGREES 

-10.88  3.7*4  DEGREES 

-1.09  1.98  DEGREES 

-.02  .*74  DEGREES 


CORRELATION  COEFFICIENTS.  R(I.J) 


-.707 

.192 

-.133 

-.656 

.670 

.190 

-.130 

.063 

.282 

.258 

.111 

-.060 

.991 

-.057 

.109 

-.17* 

.203 

-.13* 

.111 

.182  .115 


232 

239 

233 

2*0 

23* 

2*1 

235 

2*2 

236 

2*3 

237 

?*♦ 

238 

2*5 

2*6 

2*7 

2*8 

2*9 

250 

251 

252 

253 

25* 

255 

256 

257 

258 

259 

261 

262 

263 

26* 

260 

265 


51 


266 


APPENDIX  C  FINAL  PRINTOUT  OF  2436  PARAMETERS  MEASURED 
ON  ONE  SUBJECT  IN  EXPERIMENT  2 

Variables  significant  at  the  5-percent  level  are  marked  by  arrows,  in  the  following  computer  printouts. 


53 


Preceding  page  Wank 


P I NNCOt  10/23/72 

roll  ano  pitch  tracking 


number  or 

LAST  VARIABLE 
PRINTCO  ON  LINE 


►444 MEAN, • a 

..SO. ...UNITS 

TURN  rate 

•a  5fl 

.65  4DEG/SEC 

puner 

2285.72 

7.23  RPM 

RUOOER 

2.73 

9.87  rct  right 

ELEVATOR 

-1.82 

9.90  PCT  FRONT 

AILERON 

2.71 

9.75  pct  right 

NS  DEV 

-666.32 

398.91  FEET 

AIRSPEED 

109.07 

2.334  MPh 

altitude 

1097.58 

26.534  FEET 

CLIMB  RATE 

58.30 

122.01 4  FT/MIn 

ROLL 

•1.89 

9,774  DEGREES 

pitch 

2.694 

1.8o4  DEGREES 

YAK 

-1.11 

2.194  DEGREES 

2 

4 

6 

a 

10 
12 
1  4 
If, 
18 
20 
22 
?4 


CORRELATION  COEfFICXENTS*  R(I*J) 


-.0534 

-.380 

-.007 

-.001 

-.027 

.0194 

.989 

-.059 

.0274  .1634 

-.028 

.121 

-.190  .055 

.208 

-.019 

-.795 

.059  .133 

.0504-.  076 

.059 

-.376 

-.1094  .123 

•  099  4  .  09  6  4 

.426 

-.100 

-.529 

.0304  .352 

.019  .037 

•  7(13 

.819 

-.0294 

.190  -.036 

.327  .,182 

-,036 

.065 

.108 

-.159  4-.  221 

-.016  ,023 

-.227 

-.099 

.1514 

.117  -.089 

.119  .,196 

-•151 

25 

>? 

30 

14 

19 

45 


•2I*  ,  60 

-.030  -.128 

.1904 -.291  .001  T9 

■  .079  ■•297  -.019  .0994  90 


BY  HIGH  FREQUENCIES  ONLY 
lon  frequency  Gain 
LON  FREQUENCY  CROSSOVER 
lon  frequency  phase 

MI  FREQUENCY  GAIN 
HI  FREQUENCY  CROSSOVER 
HI  FREQUENCY  PHASE 
EQUIVALENT  time  OELAv 


29.79409 
.39  HE 

•139.22  DEGREES 
2.09409 
.304*2 

■195.7*40EGREES 

.sis4sec 


7713.99  DEfl«OEG 
22.72  DEONOEQ 
9.714OEO«0EG 
1.9:  OEGNDEG 
3.09  C^OVOEG 


100.00  PCT 
20.71  PCT 
7,19  PCT 
1 3,5S4PCT 


93 

99 

99 

1  o2 
lnS 
109 
111 
119 


119 

ue 

120 
121 
122 
1  J3 
129 
125 
129 
127 


BY  HIGH  FREQUENCIES  ONLY 
LON  FREQUENCY  PHASE 

high  frequency  phase 


-193.79  OCG  4 
-279.90  OEG 


22.72  OEG»DEG 
1.89  OEG*DEG 
1.57  OEG9DEG 
.3o40EG*OEG 


100,00  PCT 
9.29  PCT 
9.93  PCT 
1.334PCT 


129 

131 

133 

135 

137 

139 

191 

193 

l  95 
197 
1  99 
15(1 
151 


ROLL  ANALYZED  AT  THE  REMNANT  FREQUENCIES 

FREQ  AMPLITUDE 
(HZ)  (00) 

•SOt  -IS. 28 

•OIL  -19.22 

•021  -20.32 

•  0*5  -14.67 

•104  -22.38 

.139  -25.09 

•240  -30.95 

.389  -43.04 

ROLL  H£AN  SQUARE  ERROR  <M$E> 

HSE  ACCOUNTEO  FOR  8Y  REHNANT  FREQUENCIES 
BY  LON  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 


PITCH 

analyzeo  at  the  roll 

FREQUENCIES 

FREQ 

ISOLATION 

PHASE 

(HZ) 

(OB) 

(DEG) 

.002 

•  66.204 

-108.77 

.010 

.42.65 

-156.794 

•  029 

-33.75 

-204.75 

.057 

-26.72 

-48,80 

.125 

-25.87 

•111.13 

•  191 

•20.90 

•216.91 

•  307 

-19.17 

-212.40 

.467 

-24.65 

-329.71 

PITCH 

MEAN  SQUARE  ERROR  (MSE) 

MSe  ACCOUNTEO  FOR  BY  ROLL  FREQUENCIES 

BY  LON  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 

LON  FREQUENCY  PHASE  -129,78  DE8 

HI  Oh  FREQUENCY  PHASE  -249.98  DEG 


22.72 

OEG-OEG 

100,00 

>  CT 

152 

153 

154 

155 

156 

157 

158 

159 

1 .82 

OEG-OEG 

8.00 

'CT 

161 

1.60 

OEfloOEG 

7,02 

HCT 

163 

.22 

DEQOOCG 

.97 

PCT 

)  65 

3>23  OEG*DEG 

100. 00  PCT 

167 

169 

171 

173 

175 

177 

179 

181 

.07  0E8-0EG 

2.09  PCT 

183 

.05  OEG*DE8 

1.61  PCT 

185 

• 0240EG*DEG 

.494>CT 

187 

188 

189 

PITCH  ANALYZED  AT  THE  PITCH  FREQUENCIES 


FREQ 

(HI) 

.004 

•  014 
.027 

•  053 
.115 

•  158 

•  283 
.535 


GAIN 


GAIN 

I0BI 

38.«2« 

22.56 

23.10 

12.82 

7.30 

3.564 

•1.584 

•7,63 


PHASE 

(OEQ) 

249.044 

248.94 

187.14 

176.72 

151,62 

141.28 

•138,27 

.145.484 


85.2984 

13.434 
14.294 
4.373 
2.319 
1.5074 
.8344 

.415  _ 

mean  square  forcing  function 

PITCH  MEAN  SQUARE  ERROR  (MSE) 

MSE  ACCOUNTEO  FOR  BY  PITCH  FREQUENCIES 
BY  LON  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 
LON  FREQUENCY  GAIN  24.28  08 

LON  FREQUENCY  CROSSOVER  ,23  HZ 

LON  FREQUENCY  PHASE  -2IS.4g40EGRCE! 

HI  FREQUENCY  GAIN  .42408 

HI  FREQUENCY  CROSSOVER 

MI  FREQUENCY  PHASE  -144.16  DEGREE! 

EQUIVALENT  TIME  DELAY  .4024SEC 


501.87  0E8*0EG 
3.23  DEO»DEG 
1 . 3640EQOQEG 
.56  DE0-DE6 
.81«OEG»DEG 


100.00  PCT 
42.23  PCT 
17,30  PCT 
24,93  PCT 


192 

195 

198 

201 

204 

207 

210 

213 


215 

217 

219 

220 
221 
222 

223 

224 

225 

226 


PITCH  analyzed  at  the  remnani  frequencies 

FREQ  AMPLITUDE 
(HZ)  (OB) 

.006  20,52 

.016  20.51 

.021  20.45 

.045  20.074 

.104  18.06 

.139  15.67 

•240  -1.68 

.389  9.524 

PITCH  MEAN  SQUARE  ERROR  (MSE) 

MSE  ACCOUNTEO  FOR  BY  REMNANT  FREQUENCIES 
BY  LON  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 


3.23 

OEG*OEO 

100.00  PCT 

227 

228 

229 

230 

231 

232 

233 

234 

1769,86 

DEG4DEG 

54817,48  PCT 

236 

1413.20 

OEG-DEG 

43770.80  PCT 

238 

356.66 

DEQPOEG 

11046.68  PCT 

240 

55 


* 


WIF 


PlNNEOi  10/23/T2 

ROLL  A  NO  2  ITCH  TRACKING  NITm  POME**  CHANGES 


number  or 

LAST  VARIABLE 
PRINTED  ON  LINE 


MEAN . SO. ...UNITS 


TURN  rate 

-.50 

•  7*4  OE0/SEC 

ROVER 

2201.66 

2*5.0* 

RPM 

RUOOER 

•  ,** 

6.38 

PCT  RIOHT 

ELEVATOR 

•2.5* 

1.7* 

PCT  FRONT 

aileron 

9.9* 

9.09 

PCT  RI0MT 

NS  Oi  V 

-160. 2* 

122.66 

FEET 

AIRSPEED 

101.19 

10.38 

MPH 

ALTITUDE 

1060.0* 

3T.084FECT 

CLIMB  RATE 

5T. 794153. IS 

FT/MlN 

ROLL 

.2* 

9, *14  0E8REES 

PITCH 

3.664 

2.18 

OEQREES 

VAN 

«1.*1 

2. *24  OEORECS 

2  At 
2A* 
2«t 
EAR 
2S0 
232 
29A 
2SA 
256 
2A0 
262 
26A 


CORRELATION  COEEriCIENTS.  RII.JI 


.032 

•.**3 

-.027 

-.020 

.151 

.010 

.A3* 

..0*6 

-.1164 

.09* 

-.157 

-.078 

,*74 

*  4  1 1  3 

-.161 

•.02* 

-.771 

.005 

*4  1^0 

.16* 

.1*1 

•.003 

.306 

-.1*64 

.17* 

.123 

-.2*3 

-.011 

•.061 

-.0*64 

.009 

.350 

.0*0 

-.027 

.115 

.26* 

.6*3 

-.0**4 

.3184 

.175 

.259 

-.03* 

-.209 

-.0*7 

.02* 

.326 

-.075 

-.101 

-.661 

.178 

-.**1 

-.008 

-.077 

-.081 

-.0204 

.30* 

-.028 

.04* 

.o3o 

-.015 

26B 

267 

270 

ETA 

276 

265 

2*2 

300 

30* 

3»* 

330 


ROLL  ANALYZEO  AT  THE  ROLL  FREQUENCIES 


FREQ 

OAIN 

OAIN 

phase 

1HZI 

(OBI 

(OE8I 

.002 

32.508 

30,2* 

•31.25 

.010 

38.158 

11.61 

•107. *1 

.029 

9.637 

19.704 

.113.02 

.057 

3.372 

11.0*4 

•111.62 

.125 

1.9374 

5.264 

-125. *1 

.191 

1.2324 

1.964 

-11T.654 

.107 

.8**4 

-1  .*7  4 

-151.69 

.467 

.6034 

-*.i*4 

-161.08 

*t*N  SQUARE  FORCING  FUNCTION 

ROLL  MEAN  SQUARE  ERROR 
MSE  ACCOUNTEO  FOR  BT  ROLL 
or  LON  frequencies  only 

8Y  HI  OH  FREQUENCIES  ONLY 
LON  FREQUENCY  SAIN 
LON  FREQUENCY  CROSSOVER 
LON  FREQUENCY  PHASE 
HI  FREQUENCY  OAIN 
HI  FREQUENCY  CROSSOVER 
HI  FREQUENCY  PHASE 

equivalent  time  delay 


(MSE) 

FREQUENCIES 


23.1*405 

•  B3*Z 

•*6,30  0E3REES 
.3*408 
.25  HJ 

•1*0,06  OEtREES 
.573  SEC 


7713,56  OESAOEO 
3*. *6  OEONOCO 
12. A*  OEO*OCO 
8.26  OEONOEO 
A, 2)  OEONOCO 


100.00  PCT 
35.73  PCT 
23.63  PCT 
12.10*»CT 


313 

316 

33* 

3A2 

3*5 

3A0 

331 

ISA 


356 

350 

360 

161 

362 

363 
36* 

365 

366 
36T 


ROLL 


ANALYZEO  AT  THE  PITCH 


FREQ 

ISOLATION 

PHASE 

(HZI 

1081 

(OEO) 

.00* 

-29.68 

-2**. 99 

.01* 

-21.2* 

-90,52 

•  027 

.16.88 

-36.3* 

.033 

-6.26 

•101.T* 

.115 

-8.674 

-230.17 

•  150 

-1.7* 

-216.01 

•  201 

-6.1* 

•292.3* 

.313 

-13.22 

-3*8.22 

frequencies 


mean  SQUARE  ERROR 
MSE  ACCOUNTED  FOR  8Y  PITCH 
BY  LON  FREQUENCIES  ONLY 
BY  HI OH  FREQUENCIES  ONLY 
LON  FREQUENCY  PHASE 
MI  OH  FREQUENCY  PHASE 


(MSE) 

FREQUENCIES 


-123.96  DEI 
•307,6*  OC< 


36,96  OEONOEO 
1.70  OEONOEO 
I.A8  OEONOCO 
.22  OEONOEO 


369 

171 

171 

175 

377 

37* 

361 

381 

100.00  PCT 

4.85  PCT 

385 

4,23  PCT 

3*7 

.624PCT 

38* 

1*0 

1*1 

56 


moll  analyzed  at  the  remnant  frequencies 


ENCO 

AMPLITUDE 

(HZ) 

(08) 

.006 

.13.67 

.016 

-21.96 

.021 

-24.13 

•  045 

-23.04 

.104 

.38.96 

.139 

-35.63 

.240 

-34.71 

.309 

-40.81 

null 

MEAN  SQUARE  ENRON  (NSC) 

NSC  accounteo  eon  sy  remnant  frequencies 
st  lot  ercouencies  only 
■  Y  HISH  ENEOUCNCICS  ONLY 


34.96  0CS*DC0 

2.06  ocs»oc6 

2.03  DE6*0E6 
•93  DEO'DEO 


ISO. 00  NCT 
S.00  NOT 
S.S1  NCT 
.01  PCT 


PITCH  analyzed  at  the  roll  eneoucncics 

ENEO  ISOLATION  PHASE 

I  HZ I  1081  (DEO) 

.002  >94.18  >1.30 

.010  -42. TO*  -52.34 

•020  -27,81  -281.67 

•  057  -23.93*  -357.98 

.125  -19.57  -30.98 

•191  -32.45  -244.82 

.307  -18.45  -247.87* 

.467  -17.82  -340.97 

PITCH  MEAN  SQUARE  ERROR  (MSE) 

nsc  accounteo  eon  by  roll  eneoucncics 

87  LON  ENEOUCNCICS  ONLY 
BY  HI0>  ENEOUCNCICS  ONLY 

lon  freQ'ency  phase  -173.34  nco 

HI  OH  FREQUENCY  PHASE  -259.49  DCS* 


5.66  0ES»DC6 
•  17*D£8*0ES 
• 14*0C3*DC0 
•03  DE8*0C8 


100.00  PCT 
2.994PCT 
2.4S6RCT 
.49  PCT 


407 

40  9 


411 

413 

418 
417 

419 
421 


428 

428 

429 


PITCH  ANALYZED 

AT  THE 

PITCH 

FREQUENCIES 

ENCO  8AIN 

SAIN 

PHASE 

(H2I 

(D8) 

(DEO) 

.004  15.300 

23.69 

•15.92 

.014  16.493 

24.35 

.157.57 

.027  7.268 

17.23 

-159.93 

.053  3.610 

11.15 

.149.92 

.115  2.504 

7.97 

.125.37 

.156  1.324 

2.44 

.123,09 

.263  .707 

-3.01 

.108.35 

.535  .368 

-8.69 

.152,3' 

MEAN  SOUARC  EORC1N8  FUNCTION 

591.87 

DE8*DE6 

PITCH  MEAN  SQUARE  ERROR 

(MSE) 

5i66 

OES*DEQ 

MSE  ACCOUNTEO  EON  8V  PITCH 

FREQUENCIES 

2.92 

0E6*0C8 

BY  LON  ENEOUCNCICS 

ONLY 

P.44  OE8»OE8 

6'  HI8H  FREQUENCIES  ONLY 

48 

DC8*DCS 

LON  FREQUENCY  GAIN 

19,10 

08 

LON  FREQUENCY  CROSSOVER 

.90 

HZ 

LON  FREQUENCY  PHASE 

•120.84 

0C5RCCS 

Hi  FREQUENCY  QAIN 

••32 

Dl 

Hi  FREQUENCY  CROSSOVER 

.22 

HZ 

HI  FREQUENCY  phase 

•127.21 

DECREES 

EQUIVALENT  TIME  DELAY 

•  328 

SEC 

100.00  PCT 
S1.41*RCT 
43.056RCT 
8.56  PCT 


PITCH  ANALyZCO  AT  THE  REMNANT  ERCOUENCIES 
ENEO  AMPLITUDE 
(HZ)  108) 


.906 

.11.03 

467 

•  016 

-19.89 

468 

.921 

•16.82* 

469 

.945 

-15.75 

470 

.194 

-24.15 

471 

•  139 

-24.48 

472 

•  249 

-30.60 

473 

.389 

•35.25 

474 

PITCH 

MEAN  SQUARE  ERROR  (NSC) 

5.66  OCB’OEO 

100.86  PCT 

MSE  ACCOUNTEO  FOR  BY  REMNANT  FREQUENCIES 

•82  0Ca*D£0 

14.51  PCT 

476 

BY  LON 

FREQUENCIES  ONLY 

.77  0C840EQ 

13.66  PCT 

478 

SY  HISH  ERCOUENCIES  ONLY 

.05  OCO*OCO 

.86  PCT 

460 

57 


- ...  ■ .. 


* 


•ra 


PlNNEO,  10/23/72 
UtO  CLIMB 


mummer  07 

LOST  VARIABLE 
MINTED  ON  LIME 


TURN  RATE 

PORE* 

RUDDER 

ELEVATOR 

RILE RON 

N*  OEV 

AIRSREED 

ALTITUDE 

CLIMB  RATE 

ROLL 

PITCH 

VAR 


•  •mean . SO. ,, .UNITS 

-.43  .9*  DEB/SEC 

2*57.2*  37.52  RPM 

1.93  4.46  PCT  RIOHT 

•2.914  1.M4PCT  FRONT 
10.71  4.B4  PCT  RI8MT 

-97.57  49.09  FEET 

*3.1*  3.19  MPH 

1143,44  34,26  FEET 

427.14  1(1.93  FT/MIn 

1.04  2.974  DEGREES 

0.27  1.7*  OEOREES 

•1.11  2.16  OEOREES 


402 

4B4 

406 

400 

490 

492 

494 

496 

490 

900 

902 

9n* 


CORRELATION  COEFFICIENTS.  R(I.J) 


.079 

-.702 

-.00* 

•,021 

-.216 

.120 

.993 

-.024 

•  •324 

.137 

-.152 

.430 

.0*4 

.123 

-.0*9 

-.102 

-.720 

.231 

.234 

-.036 

•.046 

-.617 

.132 

.161 

-.006 

-.250 

-.133 

.257 

.307 

-.160 

.0*7 

.096 

-.3*2 

.009 

.457 

.251 

•  .270 

-.205 

-.179 

.250 

.099 

.100 

.017 

-.016 

.224 

-.305 

-.440 

.761 

.506 

.211 

.045 

-.195 

.001 

.033 

-.1634 

-.4334 

.276 

.3*0 

-.5*7 

.137 

.060 

-.291 

-.240 

-.167 

.096 

595 

507 

510 

51* 

519 

525 

532 

540 

549 

559 

•034  570 


P1NNE0.  10/23/72 
LEVEL  360  OEGREE  RIGHT  TURN 


NUMBER  OF 
LAST  VARIABLE 
PRINTED  ON  line 


turn  rate 

porer 

rudder 

elevator 

aileron 

mead  dev. 

AIRSPEED 

altitude 

CLIMB  RATE 

roll 

PITCH 


...MEAN.,, 

2.00 

2*51.23 

19.12 

-2.994 

-9.43 

•320.99 

109.91 

1567.37 

142.26 

19.49 

2.46 


..SO.. ..UNITS 
.62  OES/SEC 

9.66  RPM 
3,40  PCT  Rtao 

2.724  pct  From 

3.99  PCT  RI3H 


T.TT 

3.31 

54.27 

209.06 


DEGREES 
MPH 

feet 

-  FT/MIN 

6.4*4  DEGREES 
1.97  DEGREES 


572 

57* 

576 

570 

500 

50? 

504 

506 

500 

590 

592 


CORRELATION  COEFFICIENTS.  RlI.Jl 


-.4*5 

.2*4  ..404 

593 

.34*  .,335 

.3)0 

595 

-.011  .10* 

-.0*4 

.043 

59* 

*.641  .643 

-.4*2 

-.310  .2*0 

*02 

,37T  .,794 

.379 

.3*34 -.1*0 

0,565 

607 

.903  ..70S 

.400 

.296  -.190 

*4690 

.744 

*13 

-.24*  -.303 

-.063 

.113  .007 

#040 

.*074 

.121 

620 

••517 

.5*5 

.39?  -.140 

•  r  720 

.499 

.6*7  -.209 

620 

t?W  01)56 

.1*4 

.01*4-. 190 

••330 

.097 

,330  .,435  ,325 

*37 

**T 

58 


. .w  ri'n'i.'f'T' 


'WWW' 


■  <...nHI||.|.|.V.Wl|.  I||,ail,l  ,11,  "  Ml  MIK-III*'. 1.1  -I  - 


«NWJ.  10/23/72 
SLOW  FLIOHT 


NUMBER  OF 
LAST  VARIABLE 
FAINTED  ON  LINE 


TURN  RATE 
FOVEA 

rudder 

ELEVATOR 

AILERON 

NS  DEV 

AIRSFEEO 

ALTITUDE 

CLIMB  RATE 

ROLL 

FITCH 

YAM 


•  •MEAN . SO... .UNITS 

-.944  .AS  OEO/SEC 

1746.41  179.224  RFM 

4. SB  A.BB  FCT  RtOHT 

-2.244  2.694  FCT  FRONT 

1.67  4.93  FCT  RlflHT 

•49.09  66.01  FEET 

61.934  6.404MFH 

1962.61  33.664  FEET 

44.69  4  100.49  FT/MlN 
-Z.4Z  Z.994  DE6REES 

4.904  1 .464  OESREES 

•1.40  2.19  DESREES 


649 

691 

693 

699 

69T 

699 

661 

663 

669 

667 

669 

671 


CORRELATION  COEFFICIENTS.  RII.J) 


.097 

9Fa445 

.342 

*»021 

.404 

.279 

/  421 

.196 

•.262 

.208 

•  •l|S 

.299 

•  .366 

•.443 

*•117 

.039 

.372 

.271 

.0294 

••301 

.096 

•  .9174 

•  .269 

-.361 

-.10941 

1.112 

..3664 

.063 

.116 

•  .  130 

.140 

.0104 

.011 

•  .126 

.203 

.671 

.124 

•  .263 

•.006 

.4664 

.117 

••060 

.124  .079 

.179 

•  o  194 

•  .246 

-.3644 

.0104 

.171 

..*974 

.1604 -.269 

*  a  037 

•  •0t7 

.192 

•.142 

.1704 

.1264 

.064 

.096  -.216 

672 

674 

67T 

661 

666 

692 

699 

707 

716 

726 

737 


FINNEO.  10/23/72 
DESCEND1N0  360  DEGREE  LEFT  TURN 


NUMBER  OF 
LAST  VARIABLE 
FRINTEO  ON  LINE 


s « • gMEmN* ••••SDbas tUNf TS 

TURN  RATE 

-2.70 

.194  OEO/SEC 

fqker 

1291.10 

119.24 

RFM 

RUDDER 

•21.06 

3.024FCT  right 

ELEVATOR 

•6.964 

2.244 FCT  FRONT 

aileron 

21.67 

9. 62 

FCT  RIOHT 

head  DEV. 

30.764 

21.17 

DEGREES 

AIRSFEEO 

7S.20 

1.70 

mfm 

ALTITUDE 

1047.214 

62.16 

FEer 

CL I NS  RATE 

•494.49 

190.67 

FT/MIN 

ROLL 

•7.11 

2.664 

i  OESREES 

FITCH 

2.62 

1.764 

i  DEGREES 

739 

741 

743 

749 

747 

749 

791 

793 

799 

797 

799 


CORRELATION  COEFFICIENTS.  RII.J! 


.169 

.149 

.290 

.036 

.466 

.0064 

•  22T 

.392 

•.134 

.111 

-.030 

.361 

-.499 

.464 

.440 

•.320 

.366 

•  .304 

.294 

.990 

.409 

•.111 

.414 

-.443 

.121 

.900 

.829 

.940 

•.09T 

.1304 

-.269 

.999 

.194 

.990 

.601 

.397 

.669 

.*10 

*•046 

-.196 

-.304 

-.964 

-.169 

.1414 

-.0194 

.249 

*•300 

-.124 

-.129 

•  .400 

•  .094 

760 

762 

769 

749 


774 

760 

767 

799 

604 

614 
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HmSiVMtolm  Ifcniwiil 


.•WW?iW,W 


'T"T'  '  T1W-1--W 


PPMPVPWP 


P1NNE0.  11/2 3/Tt 
Sit  fOOT  DESCENT 


number  or 
LIST  VARIABLE 
PRINTEO  ON  LINE 


TURN  RAT* 

rout 

ruooer 

ELEVATOR 

AILERON 

NS  OIV 

•IMKEO 

ALTITUDE 

CL INI  RITE 

ROLL 

RITCN 

TAN 


•  .MEAN.  ii  uSDim i UNITS 

••IT  1.I240ES/SEC 
IMS.**  «.*?  RRN 

i». Si  ii.li  rct  Hint 

s.is  J.SI  RCT  RronT 

is. st  11.124107  hint 

2131.14  3I.4|  REET 

71.474  |,I3  NRH 

11S1.7S  21. SI  feet 

•141,13  131.33  RT/NIn 

•  .48  4.014  OESREES 

.23  3.18  OESREES 

.3,41  3.10  OESREES 


111 
IIS 
•  20 
122 

■21 

•21 

•  10 
132 
•  14 
•14 

111 


CORRELATION  COEFFICIENTS.  R(l.J) 
•  ,23S 


*,!•« 

.141 

.0114 

.114 

-.0384 

.523 

•  .101 

•  1 039 

-.*•* 

.451 

•  «2S0 

.2304 

-.423 

•,022 

•  .243 

.1004 

•  i237 

.433 

-.404 

•.*15 

.001 

.111 

.044 

.045 

•  2S0 

.225 

-.034 

•  .20S 

.401 

*  iOll 

.314 

•  •441 

.••3 

.ISO 

•  •111 

*4  141 

.013 

.278 

••442 

-.041 

.144 

.221 

*,394 

•  20T 

•.342 

.401 

•  .SOT 

-.•21 

.181 

.431 

-.148 

,♦8* 

..SIB 

,4SB 

•  10 
141 
•44 

I4S 

•S3 


,108  IT4 
-.2*4  ••03T  Ml 
•,0T1  •illl  .OTI  113 
•,03S  .141  -.041  •••03  004 


RINNEO,  10/23/72 
ILS  LAN01NS  APRROACH 


NUMBER  OF 
LAST  VARIABLE 
PRINTED  ON  LINE 


TURN  RATE 

ROVER 

RUOOER 

ELEVATOR 

AILERON 

AIRSPEED 

ALTITUDE 

CLIMB  RATE 

NOLL 

PITCH 

VAV 

SLIOESLOPE 

LEFT/R1SHT 


•  .MEAN . SO, ...UNITS 

••824  .114  DEO/SEC 

1*21.05  112.31  RPM 

•S.2S  1.01  RCT  RISHT 

•1 .84  2.114  RCT  FRONT 

0.12  1.31  RCT  RIBHT 

OS.  754  2.10  NPH 

•T2.104  01.02  FEET 
•300. 4S  1ST, So  FT/MIN 
2.00  1.3S4  OESREES 

1.43  I.T34 OESREES 

•IS. TO  2. T44  OESREES 

-.45  1 .T|  OESREES 

.01  ,44  OESREES 


•04 

90S 

010 

9.2 

014 

*14 

Oil 

0*0 

0*2 

•24 

024 

021 

010 


CORRELATION  COEFFICIENTS.  R(I.J) 


.Oil 

s.||3 

.014 

OR  #  017 

.184 

.100 

.401 

.108 

••3*0 

.2*1 

.013 

*4 147 

-.040 

.210 

.1ST 

.•14 

.147 

.14* 

•  .0*14 

•.1*1 

.122 

.057 

.404 

•»03S 

.154 

.121 

•  SOS 

.200 

.7054 

.015 

-.211 

.Oil 

,424 

.024 

.**) 

*•  122 

-.8044 

.114 

*  #223 

•  .214 

•  .104 

.  OST 

.on 

.031 

•  9  032 

•  .221 

•  •143 

.072 

.034 

.105 

•  04T 

*  •  174 

-.42* 

-.4*0 

-.220 

.123 

.070 

-.010 

,»»T 

•  0T4 

.147 

.074 

Oil 

033 

014 

040 

04S 

081 


-.841  ,011  OTS 

••034  .140  .004  0«s 

•  »4S4  .100  •.01*4  .111  004 

.071  ,133  -.002  .040  -.OS*  100S 


60 


OP 


PINNEO.  1 0/23/72  NUMBER  OF 


last  variable 


ROLL  TRACK I NS 

PRINTED  ON  LINE 

•CSSS .MCANs SSSsSDss s, UNITS 

TURN  RATE 

-.S3* 

1.234  OEG/SEC 

1010 

ROVER 

21*4.01 

111.724RPM 

1012 

RUDDER 

-2. S3 

13.39  RCT  RISMT 

101* 

ELEVATOR 

-1.B2 

3. BO  RCT  FRONT 

1016 

aileron 

B.»2 

19.21  RCT  RISMT 

1016 

NS  OEV 

•1062. 3T 

196.26  FEET 

1020 

AIRSPEED 

OB. BO 

1 .  T9*  MRH 

1022 

ALTITUDE 

10*0.32 

32.634  FEET 

102* 

CLIMB  RATE  0*. BS 

16*. 734  FT/HIn 

1026 

ROLL 

1.16 

•»-oa4  degrees 

1020 

PITCH 

3.66 

l.az >  DE9REES 

1030 

YAK 

•2.16 

3.014  DEGREES 

1032 

CORRELATION  COEFFICIENT*, ,  R(I.J) 

-.03A 

1033 

*.AAT 

.090 

1039 

-.OBJ 

.1*2  .IT* 

1030 

.*60 

.100  .321  Si  .  19B 

10*2 

-.100 

•0B0  -.093 

-.011  .0*9 

10*7 

.028 

-.10*  -.029 

.2234-. 0294  .090 

1093 

.039 

-.136  .009 

.098  -.096  -.213 

.16* 

1060 

-.03* 

.990  .0** 

.3*6  .030  .030 

.323  .239 

1060 

.TSO 

..090  .1B6 

.027  .696  -. 1  TO 

.02*4  ,0634-. 036 

1077 

.031 

-.30*  -.096 

-.217  -.0694 -.02* 

-.0074  .170  ..*» 

.017 

1087 

-.COB 

-.02*  . 16T 

.000  .270  -.0*7 

-.001  .060  -.120 

.090  .OB* 

109B 

roll  1 YZEO  AT  THE  ROLL  FREQUENCIES 


FRED 

'  '11 

GAIN 

PHASE 

IMZ) 

(OB) 

IOEOI 

.010 

29.611 

20.10 

.100.66 

Uni 

.029 

21.0*2 

26.77 

-160.90 

lln* 

.031 

0.30* 

10.37 

-00.00 

11»7 

•  030 

12.0314 

21.614 

-76.73 

llln 

.060 

0.390 

10.62 

-162.91 

1113 

.06* 

6.300 

12.074 

-137.02 

1116 

.000 

9.39*4 

16.974 

-161.17 

1119 

.100 

6.2964 

12.904 

-01,16 

1122 

.123 

2.2224 

6.034 

•133.00 

1129 

.190 

1.9904 

3.014 

•126.03 

1120 

.107 

1.3264 

2.69  4 

-126,63 

1131 

.2*0 

.0994 

-.604 

-136.62 

113* 

.316 

.7634 

-2.39  4 

-1*1.02 

1137 

.306 

.9994 

-6.91 4 

-199.00 

11*0 

.400 

.9134 

-s.to4 

•173,00 

11*3 

.627 

.9094 

-9.03  4 

-102.60 

11*6 

mean  square  forcing  function 

063. *7  0£G»Ur.0 

roll 

MEAN  SQUARE  ERROR  (MSE) 

63.32  0EG*DE9 

100. 00  PC7 

MSE  ACCOUNTEO  FOR  OV  ROLL  FREQUENCIES 

29.8SSOEQKOE3 

*7,18  PCT 

11*0 

OV  LOK  FREQUENCIES  ONLY 

7.66S0EG60E9 

12.*24PCT 

1190 

BY  HIGH 

FREQUENCIES  ONLY 

22.01  OEG*OEG 

3*.77^CT 

1192 

LOO  FREQUENCY  BAIN 

10.61400 

1193 

LOK  FREQUENCY  CROSSOVER 

•  3*4HZ 

1196 

LOK  FREQUENCY  PHASE 

•123.2*  DEOREES 

1199 

HI  FREQUENCY  gain 

-.72400 

1196 

HI  FREQUENCY  CROSSOVER 

. 264*2 

1197 

HI  FREQUENCY  PHASE 

-1*7.76  0E9REES 

1190 

equivalent  time  delay 

.47*  SEC 

1199 

ROLL 

ANALYZED  AT  THE  REMNANT 

frequencies 

FREQ 

AMPLITUDE 

(M2) 

(OB) 

.023 

-22.00 

1160 

.037 

-31.07 

1161 

.0*1 

-10.07 

1162 

.0*9 

•10,60 

1163 

.090 

.29,60 

116* 

.076 

>21.69 

1169 

•  00* 

-17,06 

1166 

•  110 

-21.70 

1167 

.166 

-10.63 

1160 

•  102 

•29.01 

1160 

.2*2 

•20.624 

1170 

.207 

•96.40 

1171 

.309 

-94.99 

1172 

.**1 

.33.294 

1173 

.607 

■91.67  4 

117* 

.690 

-*1.764 

1179 

ROLL 

MEAN  SQUARE  ERROR  (MSE) 

63.32  DEQKOEG 

100.00  PCT 

MSE  ACCOUNTEO  FOR  BY  REMNANT  FREQUENCIES 

9.23  OEQKOEG 

0.26  PCT 

1177 

BY  LOK 

FREQUENCIES  ONLY 

6.06  OESKOEO 

6.61  PCT 

1170 

BY  HISH  FREQUENCIES  ONLY 

1,10  OEScOEO 

1.064PCT 

1101 

61 


wll*. 


P9DWIV 


HfPPjRr! 


PINNEO,  10/23/72 
ROLL*  PITCH  A  NO  VAN  TRACKING 


number  of- 
LAJT  VARIABLE 
PRINTED  ON  LINE 


turn  rate 

i  • • *H|ANi a « 

•  *Toi 

>  8  4  SO*  8  *  « 

2.17 

.UNITS 

OEO/SEC 

PONER 

2120.2* 

TO. 01 

RPM 

RUOOER 

1.0* 

13. *2 

PCT  RIOHT 

ELEVATOR 

-2.78 

4.19 

PCT  FRONT 

AILERON 

5.** 

17,0* 

PCT  RIOHT 

NS  DEV 

•613. *8 

299.68 

FEET 

AIRSPEED 

98.13 

2.38. 

HPH 

ALTITUOE 

1052.08 

33.35. 

FEET 

CLIMB  RATE 

TO. 3* 

1*3.30 

FT/HIn 

ROLL 

-2.3* 

12.8* 

OEOREES 

PITCH 

3.31 

2.77. 

i  OEOREES 

YAN 

-1.53 

3.75. 

i  DEGREES 

CORRELATION  COEFFICIENTS.  R(ItJ) 

•.0*8 


•.*10 

.09* 

-.071. 

.027 

.153 

.517 

.010 

-.130 

.035. 

•.055 

.1*8 

-.058 

.028 

.002 

.1*8 

•  .001 

.01* 

.258 

.0*9 

•  .211 

.075 

.110 

.009 

.078 

-.006. 

.37*  .208 

.117 

.29* 

-.01* 

.350 

-.020 

-.017  .738 

.921 

..061 

-.290 

-.028. 

.457 

•  •100.  .202 

.031 

-.123 

-.022 

-.371 

.055 

.00*  —123 

•.2*1. 

—  012. 

.3*6 

-.008 

.257 

-, 129. -.079 

.21* 
•  005 
.ITT 
—  08* 


.13* 

-.200 

•.21* 


.018 

•.22* 


•  11T 


120* 

1201 

1211 

1213 

1220 

122* 

1233 

12*1 

1250 

12*0 

12T1 


ROLL  ANALY2E0  AT  THE  ROLL  FREQUENCIES 


FREQ 

OAIN 

OAIN 

phase 

(HZ) 

IDS) 

(OEO) 

.018 

13.938 

22.88 

-123.62 

.825 

4.1*5 

12.39 

-54.40 

.031 

4,929. 

13,8*. 

-197.82 

.039 

5.410 

14. t* 

.153.97 

.0*9 

3,747. 

11.47. 

.146,24 

.0*4 

2.3*5 

1.48 

•1*2.89 

.080 

3.639. 

11.22. 

•198.54 

•  100 

3.050. 

9.69. 

•148.81 

.123 

4.532 

13.13 

•88.45 

.158 

1.170 

1.36 

.117.61 

.197 

.8*4 

•  1.27 

-108,** 

.248 

1.055 

.4*. 

•133.72 

.31* 

.758 

•2.40 

•1*2.69 

.396 

.613. 

•4,25. 

.1*4,33 

•  *9S 

.409* 

•7,7*. 

•170.23 

.*27 

,509. 

•5,86  . 

•213.45 

MEAN  SQUARE  PORCINO  PUNCTION 
ROLL  MEAN  SQUARE  ERROR  IHSE) 

NSE  ACCOUNTED  POR  BY  ROLL  PREQUENCIES 

BY  LON  PREQUENCIES  ONLY 
BY  HIGH  PREQUENCIES  ONLY 
LON  FREQUENCY  OAIN 
LON  FREQUENCY  CROSSOVER 
LON  FREQUENCY  PHASE 
HI  FREQUENCY  OAIN 
HI  FREQUENCY  CROSSOVER 
HI  FREQUENCY  PHASE 
EQUIVALENT  TIME  DELAY 


12.9b«OB 

•  35BHT 

•1*8,0*  DE8REES 
•.82408 
.28*HZ 

•1*2. 3T  OEOREES 
• *87  SEC 


253.33  DEO*OEO 
16*. 82  DEO*OEO 
18.104DE0*0EO 
12.9040EO*DEO 
5.29  DEO*DEO 


100.00  PCT 
11.03  PCT 
7.83  PCT 
3.214PCT 


ROLL  ANALYZEO  AT  THE  PITCH  FRE— :nC1ES 


FREQ 

ISOLATION 

PHASE 

(HZ) 

(08) 

(OEO) 

.020 

.17.6* 

•102.87. 

.027 

-10,81. 

-207.42 

.033 

•7. TO 

-254.53 

•  0*3 

-6.29 

•68. *1 

•  851 

-4.2* 

•321,06 

.0*8 

2.27 

•204.05. 

•  084 

-4.66 

-88.28 

.104 

1.25 

-1*7. *8 

. )  25 

•1.67 

•216.18 

.170 

.12.64 

•225.05 

.217 

-.10 

•161.82 

.256 

2.10 

•274.51 

.336 

•5.32 

•4.64 

.404 

•1.98 

•12.01 

•  533 

•7.13 

•26.36 

.6*3 

-6.17 

•62.23. 

RULL  MEAN  SQUARE  ERROR  |MS£) 

NSE  ACCOUNTED  >'OR  BY  PITCH  FREQUENCIES 
BY  LON  FREQUENCIES  ONLY 
BY  HIOH  FREQUENCIES  ONLY 

LON  FREQUENCY  PHASE  >180.51  0E8 

HI8K  FREQUENCY  PHASE  >1*3. *1  DCS 


16*. 82  DEO*OEO 
9.99  OEO'DEO 
9.18  OEO'OtG 
.81  DE0*0E8 


100.00  PCT 
6.0*  PCT 
5, ST  PCT 
.»*  PCT 


62 


. . 


NP.  w  iiwiiwf  wmwpwiwwin 


FREQ 

ISOLATION 

RHASE 

<MZ) 

(08) 

(DEO) 

.021 

•  ,}2 

•277.07 

.020 

•240.11 

•  039 

2.01 

•277.34 

•  047 

9.91 

•201.04 

.097 

0.41 

•290.39 

•  072 

12.14 

•317,484 

•  006 

13.92 

•9.09 

.109 

0.36 

-12.07 

•  143 

7.77 

•23.79 

.186 

10.04 

•11.714 

.220 

10.29 

•62,49 

.287 

11.474 

-78.784 

•  377 

11.884 

•111.60 

.463 

8.704 

•136.02 

.918 

7.414 

•147.11 

.678 

4.694 

•214.82 

ROLL 

MEAN  SQUARE  ERROR  (NSE) 

FREQUENCIES 


NSE  accounted  for  it  yah 

•  Y  LOH  FREQUENCIES  ONLY 

•  V  MIEN  FREQUENCIES  ONLY 


FREQUENCIES 


164*82  DESAOES 
80*70  OEO'OEt 
74*76  0ES*DES 
9*84  QE0«0£8 


100.80  RCT 
48.06  RCT 
49.36  RCT 
3.60  RCT 


NSE  ACCOUNTED  FOR  BY  ROLL 
BY  LOH  FREQUENCIES  ONLY 
BY  NISH  FREQUENCIES  ONLY 
LOH  FREQUENCY  RHASE 
HIOM  FREQUENCY  RHASE 


FREQUENCIES 


•197.66  OES 
•I00.3S  OEB 


•70  0E840EQ 
•74  0E0*0ES 
•06  OEOaOEB 


10.39  RCT 
0.63  RCT 
,73  RCT 


1374 

1376 

1378 

1380 

1382 

1384 

1386 

1388 

1300 

1302 

1304 

1388 

1308 

1488 

1482 

1484 

1406 

1408 

1418 


LOH  FREQUENCY  RHASE 

•219.32  DEB 

1411 

H18H  FREQUENCY  RHASE 

•110.48  OES 

1412 

ROLL 

analyzed  at  yhe  rehnant 

FREQUENCIES 

FREQ 

ahrlituoe 

(HZ) 

108) 

.823 

-29.08 

1411 

.037 

•21.49 

1414 

.041 

.23,18 

1419 

•  049 

•23.90 

1416 

.090 

•21.074 

1417 

.074 

•10.16 

1410 

.004 

.24.18 

1410 

.110 

•30.42 

1428 

.146 

•23.91 

1421 

.182 

•12.19 

1422 

.242 

•19.29 

1423 

.207 

•43.39 

1424 

.389 

•30.10 

1429 

.441 

•40.674 

1428 

.407 

.40.98 

1627 

.490 

.61.81 

1428 

RULL 

HEAN  SQUARE  ERROR  (NSE) 

164 .82  0E8*0E8 

100.00  RCT 

NSE  ACCOUNTED  FOR  BY  REHNAN7  FREQUENCIES 

9,02QOE8*DE8 

4,87  RCT 

1430 

BY  LOH 

FREQUENCIES  ONLY 

7.004DE8*DE8 

4.30  RCT 

1432 

BY  H18H  FREQUENCIES  ONLY 

•03  DES*DE8 

.96  RCT 

1434 

R1TCH 

ANALYZED  AT  THE  ROLL 

FREQUENCIES 

FREQ 

1S0LA7I0N  RHASE 

(HZ) 

(08)  I0E8) 

.018 

•14.00  >180.63 

1436 

.920 

.92.40  .202.834 

1430 

•  031 

•16.30  -.19 

1440 

.030 

.10.88  -337,49 

1442 

.040 

.28.934  -100.404 

1464 

•  044 

•29.91  -86.46 

1444 

.080 

.10.49  >94,76 

1448 

•  100 

.13.09  *311,94 

1490 

•  123 

.10,29  >339.004 

1482 

.198 

.20.43  >40.464 

1494 

.107 

.26.69  >41.16 

1496 

.249 

.17,93  .202.20 

1499 

.114 

.20,46  .223.72 

1460 

.104 

.24.70  -274.97 

1448 

.408 

•18,49  .310,99 

1464 

.427 

.20.96  *77,41 

1488 

R1TCH 

HEAN  SQUARE  ERROR  (NSE) 

7.47  0E9*0EO 

100.60  RCT 

1468 

1470 

1472 

1473 

1474 


R1TCH 

ANALYZEO 

AT  THE 

RITCH  FREQUENCIES 

FREQ 

SAIN 

SAIN 

RHASE 

(HZ) 

IDS) 

(DEO) 

.026 

24.721 

27,94 

•290.41 

1477 

.927 

0.400 

10.49 

.243,4? 

1689 

•  933 

7.080 

18.09 

-178.37 

1403 

•  043 

44, OSS 

31.928 

•24,40 

1686 

.091 

9.611 

14.09 

•100.70 

1488 

•  080 

4.433 

13.32 

•149.79 

1402 

.984 

2.494 

7.99 

•123,41 

1409 

•  104 

1.731 

4.74 

•138.64 

1408 

63 


•  125 

1.623 

*.21 

•  1 70 

,868 

•1.03 

.217 

.727 

-2.77 

•  256 

.6704 

•3.374 

•  336 

.5964 

•*. *74 

•  *0* 

.3654 

•0.264 

•  533 

.1** 

•16.86 

•  693 

.271 

-11.36 

MEAN  SQUARE  FORCING  FUNCTION 

FITCH 

MEAN  SQUARE  ERROR 

»»  LOK  FREQUENCIES  ONLY 
BY  HUH  FREQUENCIES  ONLY 
ION  FREQUENCY  GAIN 
LON  FREQUENCY  CROSSOVER 
LOn  FREQUENCY  phase 
HI  FREQUENCY  gain 
HI  FREQUENCY  CROSSOVER 
HI  FREQUENCY  PHASE 
EQUIVALENT  TINE  OELAy 


-113.66 
•120,90 
•136.56 
•126.6A 
•116.03 
•116.23 
-2ST.9S 
•195. T2 


FREQUENCIES 


1T.GT  OB 

•  19  HE 

-16*. 00  DEGREES 
•S.AM0S 

•  17#1Z 

■Ui.Tl  OEOREES 
.*«?  SEC 


52. 5A  OEsoDES 
7. 67  OES*OES 
7.78  0ES*0EG 
1.37  0E6»0E0 
1.61  OEflFOEfl 


100.00  PCT 
36.22  PCT 
17.66  PCT 
18.37  PCT 


1501 

ISO* 

1S0T 

1510 

1513 

1516 

1519 

1522 


152* 

1526 

1628 

1529 

1530 

1531 

1532 

1533 


153* 

1535 


PITCH 

RNALYZEO  AT  THE 

FREQ 

ISOLATION 

PHASE 

(HZ) 

(08) 

(DEO) 

.021 

-24.88 

•67.68 

.029 

•26.52 

•157,154 

•  035 

-23.35 

•217,31 

•  0*7 

•16.70 

•190.16 

•  057 

•16,62 

•20.19 

•  072 

•6,66 

•35.92 

•  096 

•15,56 

•139.7* 

•  10S 

-7.93 

-59.71 

•  143 

-8.*1 

-75.50 

•  186 

-6.30 

-21*. 20 

•  229 

•10.16 

•179.92 

•  287 

•7,1* 

-312.71 

•  377 

-6.22 

-26*. 27 

•  463 

-12.93 

•*2. *8 

•  518 

-10.92 

•31.31 

•  678 

-17.23 

•288.92 

PITCH 

HEAN  SQUARE  ERROR 

frequencies 


-  "vwn  ■  bK  '  V"  0  1  I  mm 

67  LON  FREQUENCIES  ONLY 
67  HIGH  FREQUENCIES  ONLY 
LON  FREQUENCY  PHASE 
HIGH  FREQUENCY  PHASE 


frequencies 


•113. *8  DEO 
•190.35  OEfl 


7,67  DEG-DEG 
.*6  OEGFOEO 
•36  OEGFOEO 
•10  DEGfDEG 


100. 00  PCT 
6.01  PCT 
*.T1  PCT 
1.J0  PCT 


1537 

1539 

15*1 

15*3 

15*5 

15*7 

15*9 

1551 

1553 

1555 

1557 

1559 

1561 

1563 

1665 

1567 


1569 

1571 

1573 

1ST* 

1575 


PITCH 

ANALYZ 

FREQ 

AMPLITUDE 

(HZ) 

(08) 

.023 

•21.53 

.037 

-21.67 

•  041 

-22.84 

•  0*5 

-29,68 

.059 

-18.90 

•  076 

-26.57 

•  09* 

-28.21 

•  119 

•18.36 

•  146 

-2*. 21 

•  182 

-35.7)6 

•  2*2 

•32.36 

.297 

-3*. 51 

•  385 

-39.32 

•  **1 

-*0.17 

.607 

-45.10 

.650 

•36.01 

PITCH 

HEAN  SOU 

FREQUENCIE! 


_ REAN  SQUARE  ERROR  (MSE) 

rse  accounted  FOR  6Y  REHNAN1  frequencies 
BY  LON  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 


7.67  OEGFOEO 
•**  DEOFDES 
.39  OEO»OEG 
,0*  DEGfDES 


1576 

157T 

15TB 

1579 

1580 

1581 

1582 

1563 

158* 

1585 

1566 

1587 

1566 

1569 

1590 

1591 

100.00  PCT 

5.67  PCT 

1593 

6,13  PCT 

1595 

.5*  PCT 

1597 

YAN 


FREQ 

ISOLATION 

(HZ) 

(08) 

•  on 

•37.35 

.025 

•20.3* 

•  031 

-24.164 

•  039 

•25.96 

•  0*9 

•20.124 

•  06* 

-12.77 

•  080 

-16.75 

•  100 

•23.324 

•  123 

-31.59 

•  ISO 

•19.46 

•  197 

•22.66 

•  2*8 

•26,97 

•  31* 

•22.6* 

•  396 

•20.4* 

.496 

•27.67 

•  627 

•29,36 

ANALYZEO  AT  THE  RO 
PHASE 
(DEG) 
•91.28 
•226.30 
•16.6* 
•67,71 
•126.51 
•109,98 
•T*,21 
-1*1.6* 
•166.28 
•176.01 
-223.86 

•193.124 
•227.93 
-272,80 
•320.63 
•29*. *6 


FREQUENCIES 
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1599 

1601 

1603 

1605 

1607 

1609 

1611 

1613 

1615 

1617 

1619 

1621 

1623 

1625 

1627 

1629 


Y»U  MEAN  SQUARE  ERROR  (MSE) 

NSE  ACCOUNTED  FOR  Sr  ROLL  FREQUENCIES 
•r  LOU  FREQUENCIES  ONLr 
8Y  HIGH  FREQUENCIES  ONLY 

LOU  FREQUENCY  RHASE  -107.03  OEO 

MISN  FREQUENCY  PHASE  -Z50.2*  OEG4 


14.08  DE3*DEG 

100.00  PCT 

1.47G0ES*DES 

10.42  PCT 

1631 

1.44G0E84DES 

10.20  PCT 

1633 

.03  BESIDES 

.22  PCT 

1635 

1636 

1637 

YAU  ANALYZED  AT  THE  PITCH  FREQUENCIES 

FREQ  ISOLATION  PHASE 

(HZ)  (OB)  (OEGI 

.020  .20. 9T  -101,98 

.027  -IB. 344  -306.8* 

•  033  -U.fS  -32.U 

•043  -12.03  -122.90 

.051  -16,95  -77.05 

•  06B  -7,104  -296.51 

•0S4  -13.00  -217.61 

•104  -10,17  -299.42 

.125  -16.91  -341.31 

.170  .26.62  -354,27 

•  217  -30.434  -20,53 

.256  -16.91  -12.04 

•336  -24.00  -31,10 

.404  -20.31  -61,79 

•  533  -30,404  -9,55 

.693  -29.56  -359.44 

YAW  MEAN  SQUARE  ERROR  (NSE) 

NSS  ACCOUNTED  COR  OY  PITCH  FREQUENCIES 
BY  LOU  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 

lou  frequency  phase  -iqi.ts  deg 

HIGH  FREQUENCY  PHASE  -173.72  DEG 


14.00  DEG4DEG  100.00  PCT 

1.45  OEG-DEG  10,33  PCT 

1.44  DES'OEO  10.22  PCT 

•02  DEa»DEG  .11  PCT 


1639 

1641 

1643 

1645 

1647 

16*9 

165) 

1653 

1655 

1657 

1659 

1661 

1663 

1665 

1667 

1669 

1671 

1673 

1675 

1676 

1677 


YAU  ANALYZEO  AT  THE  YAU  FREQUENCIES 


FREQ 

GAIN 

GAIN 

PHASE 

(HZ) 

IDO) 

(DEG) 

.021 

10.751 

20.63 

•140.93 

.029 

7,377 

17.36 

-149.99 

.035 

5.190 

14.30 

•159.05 

.047 

2.547 

6.12 

-12G.86 

.057 

1.641 

11.22 

-164.79 

.072 

1.3204 

2.46 

-134.714 

•  096 

.790 

•2.05 

-141.63 

•  105 

.507 

-5.90 

.132.46 

•  143 

.233 

•12.66 

-142.004 

.106 

.202 

•11.00 

.121.08 

.229 

.29* 

•10.63 

-169.93 

.207 

.205 

•13.77 

-195.854 

.377 

.297 

•10. S6 

-201.504 

.463 

.209 

•13.61 

-233.0*4 

.5)0 

.230 

•12.78 

•236.50 

•  670 

.269 

-11.41 

•233.014 

MEAN  SQUARE  FORCING  FUNCTION 

YAW  MEAN  SQUARE  ERROR  (MSE) 


MSE  ACCOUNTED  FOR  BY  YAU 

BY  LOW  FREQUENCIES  ONLY 

BY  HIGH  FREQUENCIES  ONLY 

FREQUENCIES 

LOU  FREOUCNCY  GAIN 

LOU  FREQUENCY  CROSSOVER 

S 

LOU  FREQUENCY  phase 

•1*4 

HI  FREOUCNCY  GAIN 

MI  frequency  crossover 

-12 

MI  FREQUENCY  PHASE 

-191 

EQUIVALENT  TIME  DELAY 

G 

27.74  0E04DEG 

14.00  0E3*DEG  100.00  PCT 

5.57GCE34DEG  39.60GPCT 

4.59  DEatOEG  32.62QPCT 

.90  0ES*D£G  6,96  PCT 

?T  DB 
00  M2 
05  DEGREES 
05  DB 

fO  HZ 

M40E0REES 

464GEC 


1600 

1663 

1666 

1669 

1692 

1695 

1698 

1701 

1704 

1707 

1710 

1713 

1716 

1719 

1722 

1725 


1727 

1729 

1731 

1732 

1733 

1714 

1715 

1736 

1737 

1730 


YAW  ANALYZED  AT  THE  PENNANT 


FRCO 

amplitude 

(HZ) 

(DR) 

.023 

-17.71 

.037 

-17.90 

.041 

-33.12 

.045 

-17.09 

.059 

-21.37 

•  076 

-20.42 

•  094 

-23.61 

.119 

-32.12 

•  146 

-29.42 

.102 

•33.40 

•  242 

-41.74 

.297 

-53,66 

•  305 

-64.7* 

.441 

-50.54 

.607 

•60,00 

•  650 

-49.27 

YAW  MEAN  SQUARE  ERROR  (MSE) 

HSE  ACCOUNTED  FOR  BY  REMNANT  FREQUENCIES 
BY  LOU  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 


FREQUENCIES 


100.00  PCT 
7.59  PCT 
7.42  PCT 
.17  PCT 


14.06  0EG*0E6 
1.07  DE3*0ES 
1.04  0E04DE6 
•02  DCG*OEG 


1739 

1740 

1741 

1742 
17*3 
17*4 
17*5 
17*6 
17*7 
17*8 
17*9 

1750 

1751 

1752 

1753 
1  75* 

1756 
1 758 
1760 


65 


pinneo,  10/24/72 


REDUCED  banopith  moll  tracking 

..........  PROD!  it  6><  .,00000000 


number  or 

LAST  VARIABLE 
PRINTED  ON  LINE 


turn  rate 

POpER 

RUOOER 

ELEVATOR 

AILERON 

NS  OEV 

AIRSPEED 

ALTITUDE 

CLIMB  RATE 

"OLL 

PITCH 

YAP 


,  « • MEAN, , , 
•.»« 
2274.61 
2.11 
•1.12 
3.43 
39S7.64 
108,004 
1040.36 
50.77 
*1.47 
2,07 
*1.05 


SO. ...UNITS 

SB  OEG/SEC 
PPM 

pct  right 
pct  PROMT 
PCT  RIGHT 
PEET 
MPH 


21.  U 
7.91 
2.15 
10tl9 
.01 
2.5] 


31.474  PEET 
129.02  FT/MIn 
5 • 35  4  DEGREES 
l.Sl  DEGREES 
2.344  OEGREES 


1762 

1764 

1766 

1760 

1V70 

1772 

1774 

1776 

1778 

1780 

1782 

1784 


CORRELATION  COEFFICIENTS,  R(I.J) 
-.018 


-.414 

-.146 

-.080 

-.013 

.013 

.342 

.026 

.2414  .066 

-.006 

-.009  - 

.010  .00? 

-.001 

.021 

«.4T2 

.179  .175 

.013 

-.0244 

-.116 

.161  .050 

-.027 

.013 

-.207 

.012  ,274 

.057 

.643# 

-.146 

.387  .,102 

.408 

-.075# 

.161 

.0054*. 138 

-.06* 

-.008# 

.091 

.159  4  .  050 

.390 

ROLL 

ANALYZED  AT  THE  ROLL 

FREO 

GAIN 

GAIN 

phase 

(HZ) 

(OBI 

IDES) 

.018 

25.411 

28.10 

114.91 

.025 

15.451 

23.78 

121.54 

.031 

23.085 

27.27 

110.35 

.03* 

17.906 

25.06 

•53.51 

.049 

6.53* 

16.31 

114.50 

.064 

6.437 

16.174 

140.95 

.080 

5.666 

15.074 

130.35 

.100 

2.784 

8.89 

125.98 

•  123 

1.535 

3.724 

118.14 

•  158 

2.725 

8.71 

153.19 

.1*7 

2.009 

6.064 

131,11 

.248 

.845# 

•1.474 

130.24 

•  314 

.876 

•1.15 

144.30 

.396 

.684# 

-3.29# 

153.79# 

.498 

.527# 

-5.56# 

179.70 

.627 

.550# 

-5.20# 

187,62 

MIAN  SQUARE  forcing  function 

.006 

.002 

-.009 

-.010 

.027 

-.014 


.436 

.699  .258 

.148  .107  -.009 

•  .264  .111#  -.498 

.082  -.067  .132 


>.0484 
.063  ..0464 


FREQUENCIES 


ROLL  MEAN  SQUARE  ERROR  ( 

nsc  accounted  for  by  roll 

8Y  LON  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 
LOP  FREQUENCY  GAIN 
LOP  FREQUENCY  CROSSOVER 
LOP  FREQUENCY  PHASE 
MI  FREQUENCY  GAIN 
HI  FREQUENCY  CROSSOVER 
HI  FREQUENCY  PHASE 
EQUIVALENT  TIME  OELAY 


MSE) 

FREQUENCIES 


20.08  D8 
.2B4HZ 

•118,30  DEGREES 
.234)8 
.29412 

•149.78  OEGREES 
.482  SEC 


*91, 

28, 

9, 

7, 

1, 


84  DEGtOEG 
59  0Ea*DEG 
?940E8»DE0 
88G0EQ4DEG 
41  0EO*DEG 


100.00  PCT 
32.51  PCT 
27.57  PCT 
4.94  PCT 


1785 

1787 

1790 

1794 

1799 

1805 

1812 

1820 

1829 

1839 

1850 


1853 

1856 

1859 

1842 

1865 

1868 

1871 

1874 

1877 

1880 

1883 

1886 

1889 

1892 

1895 

1898 


1900 

1902 

1904 

1905 

1906 

1907 

1908 

1909 

1910 

1911 


ROLL  ANALYZED  AT  THE  REMNANT  FREQUENCIES 


FREQ 

AMPLITUDE 

(MZ) 

(08) 

.023 

-21.25 

.037 

-19.02 

.041 

•21.91 

.045 

•24.62 

.05* 

-28,26 

•  076 

-31.57 

•  094 

.27,54 

•  11* 

.25.63 

•  146 

-21.65 

•  182 

-33.55# 

•  242 

-27.44 

•  2*7 

•33.43 

.385 

-43.71 

•  441 

-35.96 

.607 

-46.33 

•  650 

-48.92 

ROLL 

MEAN  SQUARE  ERROR  (MSEl 

MSE  ACCOUNTED  FOR  BY  REMNANT  FREQUENCIES 
BY  LOP  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 


‘4 

1*12 

1913 

1914 

1915 

1916 

1917 

1918 
1*19 

1920 

1921 

1922 

28.5*  OCGtOEG 

100.00  PCT 

1923 

1924 

1925 
1*26 
1927 

1 <33  0CO4DCB 

4.65  PCT 

1929 

1.05  OEG<OC8 

3,66  PCT 

1931 

•28  0E8*DCG 

.99  PCT 

1933 

U1WMPIWMMH0M8844^>MPhm 


PINNEO,  10/24/72 

reouceo  anplituoe  poll  tracking 


NUMBER  or 
LAST  VARIABLE 
PRINTED  ON  LINE 


TURN  rate 

POKER 

RUDDER 

ELEVATOR 

AILERON 

NS  OEV 

AIRSPEED 

altituoe 

CLIMB  RATE 
ROLL 
PITCM 
YAK 


...MEAN . SO. ...UNITS 

-.528 

.59 

OEO/SEC 

2041.57 

48.14 

RPN 

-.21 

7.18 

PCT  RIGHT 

-.52 

1.90 

PCT  FRONT 

6.03 

5.10 

pct  right 

-437.15 

213.08 

FEET 

98.93 

l  .498  mph 

1044.43 

28.71 

FEET 

62.318 

91.56 

FT/MIn 

.01 

3.50 

OEGREES 

4,21 

1.26 

DEGREES 

-1.058 

1.538  DEGREES 

ms 

1937 

1919 

1941 

194] 

1945 

1947 

1949 

1951 

1951 

1955 

1957 


CORRELATION  COEFFICIENTS,  Rllijl 


.011 

-.600 

.012 

.057 

.035 

.006 

.259 

.042 

.2648  .170 

-.022 

.011 

.171  .104 

-.189 

.113 

-.103 

-.0408  .276 

.1014 

1  .064 

.025 

-.037 

-.016  .05] 

.0214 

1  -  .226 

.140 

.102 

.365 

.030  .375 

.045 

.134 

.549 

.167 

.542 

-.020 

.267  .135 

.509 

.170 

.094 

.0238  .139 

-.055 

-.218 

.045  -.1598 

.018 

-.042 

-.0448 

.1BB8-.376 

-.024 

.106 

.145  ,027 

.204 

-.075 

-.110 

.089  -.053 

1 084 


.212 


195B 
1 9A0 
1983 
1987 
1972 
1 975 
1985 
1993 
2002 
2012 
2023 


ROLL 

ANALYZEO 

AT  THE  ROLL 

FREQ 

bain 

gain  phase 

(M2) 

(05)  (0E8) 

.019 

U.010 

22.29  -98.004 

.025 

13.963 

22.90  -156.21 

.931 

9.441 

19.50  -89.57 

.039 

6.302 

15.99  -79.664 

.049 

4.542 

13.15  -100,20 

.064 

4.158 

12.388  -129.75 

.090 

10.861 

20.728  -65.06 

.100 

4.685 

13.42  -100.93 

.123 

1.496 

3.508  -108.91 

•  158 

1.239 

2.21  -75.64 

.197 

1.7908 

5.068  -119.85 

.248 

1.4298 

3.108  -132.21 

.314 

.8518 

•1.408  -140.36 

.396 

.5918 

-4.568  -161.31 

.498 

.5238 

-5.638  -175.66 

.627 

.5848 

•4.668  -194.85 

FREQUENCIES 


MEAN  SQUARE  F0RCIN8  FUNCTION 
ROLL  MEAN  SQUARE  ERROR  (NSEI 


MSE  ACCOUNTED  FOR  BY  ROLL 
BY  LOK  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 
LOK  FREQUENCY  BAIN 
LOK  FREQUENCY  CROSSOVER 
LOK  FREQUENCY  PHASE 
HI  FREQUENCY  GAIN 
HI  FREQUENCY  CROSSOVER 
HI  FREQUENCY  PHASE 
EQUIVALENT  TINE  DELAY 


frequencies 


17,54  08 
1.78  HE 

>102.30  DEGREES 
>.30«D8 
.278*2 

•138.60  DEGREES 
.452  SEC 


107.06  OEO*OEG 
12.28  DEG»OEG 
3.528OE0*DE6 
1.428OE0*DE5 
2.10  0E0*DEQ 


100,00  PCT 
78.67  PCT 
11.598PCT 
17.09  PCT 


2026 

2029 

2032 

2035 

2038 

2041 

2044 

2047 

2050 

2053 

2056 

2059 

20A2 

2065 

2068 

2071 


2073 

2075 

20TT 

2978 

2079 

2080 
2081 
2082 

2083 

2084 


ROLL 


ANALY2E0  AT  THE  REMNANT  FREQUENCIES 


FREQ 

AMPLITUDE 

(HZ) 

(08) 

.023 

•22.93 

.037 

•24,42 

.041 

-20.30 

.045 

•22.65 

•  059 

•15.76 

•  076 

-17.64 

.094 

-21.008 

.119 

-40.25 

•  146 

-21.81 

•  182 

•21.558 

.242 

-3v'.B2 

.297 

-25.14 

•  385 

-36.268 

.441 

.46.86 

•  607 

-36.28 

.650 

•40.55 

RULL 

MEAN  SQUARE  ERROR  (NSC) 

NSC  ACCOUNTED  FOR  BY  REMNANT 
BY  LOK  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 


FREQUENCIES 


12.28  OCGPOCG 
1.14  OEO*DCG 
.92  OEG40C0 
.21  OERaOCG 


100,00  PCT 
0,25  PCT 
7.53  PCT 
l.TI  PCT 


20A5 

2086 

2087 

2088 

2089 

2090 

2091 

2092 

2093 

2094 

2095 

2096 

2097 
2099 

2099 

2100 

2102 

2104 

2106 
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PlNNEO.  10/24/72 
GROUND  BEE.  MANEUVER 


LEET  CIRCULAR  TURN 


NUMBER  Of 
LAST  VARIABLE 
PRINTED  ON  LINE 


TURN  NATE 
POKER 

rudder 

elevator 

aileron 

RADIUS 

read  DEV. 

AIRSPEED 

ALTITUDE 

CLIMB  RATE 

ROLL 

PITCH 


•GaHCAN8«t>#5D«i, 

..UNITS 

-2.104 

2.13 

OEO/SEC 

2057.44 

101.34 

RPM 

-6.37 

10.73 

PCT  RIGHT 

-6.78 

8.10 

PCT  FRONT 

11.41 

10.40 

pct  right 

5924.104  419.19 

FEET 

9.664 

19.4840E8REES 

95.99 

4.21 

MPH 

1077.14 

53.35 

feet 

32.71 

205.18 

ft/min 

•  8,96 

11.61 

DEGREES 

4.17 

2.74 

DEGREES 

2108 
2110 
2112 
21 1 A 
2116 
2118 
2120 
2122 
212* 
2126 
2128 
2130 


CORRELATION  COEFFICIENTS.  R(I.J) 


.005 


-.631 

.2074 

.175 

.443 

.116 

.634 

-.0304 

-.332 

.147 

-.5464 

.3944 

.441 

.19? 

-.399 

-.136 

.590 

.421 

.137 

-.216 

-.050 

-.573 

-.070 

-.1764 

-.062 

-.192 

-.161 

.188 

-.071 

-.252 

-.405 

.255 

.290 

.1984 

-.313 

.928 

.051 

-.384 

.075 

.541 

.205 

-.141 

-.159 

-.506 

.037 

.3824 

-.231 

-.426 

-.205 

.141 

.3684 

.373 

.256 

.321  ,435 

-.4884 

.057 

-.084  -.105 

-.149 

- .  065 

-.070  -.024 

2131 

2133 

2136 

2140 

2145 

2151 

2158 

2166 

2175 

2185 

.316  2195 


PINNEO.  10/24/72 

8R0UND  REF.  MANEUVER  —  ALTITUDE  AND  POSITION  TRACKING 


NUMBER  OF 
LAST  VARIABLE 
PRINTED  ON  UNE 


TURN  RATE 

POKER 

RUDDER 

ELEVATOR 

AILERON 

NS  DEV 

AIRSPEED 

ALTITUDE 

CLIMB  RATE 

ROLL 

PITCH 

YAK 


..mean . SO. ...UNITS 

-.59  i,86  OEG/SEC 

2092.67  133.6l«  PPM 

3.26  13.52  PCT  RIGHT 

•  3.754  2,49  pCT  FRONT 

*.oi  ii,38  pct  right 
76.21  233.3*  FEET 

97.11  3.29  MPH 

1059.00  59.474  FEET 

66. 154225.71  FT/MIn 
-2.36  8.9(1  0E8REES 

4.34  2.1J  DEGREES 

-2.144  8 .3n  DEGREES 


2198 

2200 

22"2 

2204 

2206 

2208 

2210 

2212 

2214 

2216 

2218 

2220 


CORRELATION  COEFFICIENTS.  RII.JI 


1 2  06 

i820 

-.022 

251 

.130 

.217 

,720 

.130 

-.513 

-.124 

4094 

.021 

.35) 

.130 

-.356 

160 

-.0104 

.244 

.0524 

-.133 

.115 

015 

-.1514 

.Oil 

-.0234 

-.026 

-.177 

.0884 

013 

.564 

.078 

.188 

.030 

.004 

.461  .2464 

909 

.083 

-.534 

-.236 

.655 

-.3664 

-.100  .048  -.012 

105 

-.441 

-.134 

-.127 

.020 

-.062 

-.375  .208  -.607 

029 

-.199 

.  02 

-.173 

.152 

-.301 

-.001  ,204  .009 

2221 

2223 

2226 

2230 

2235 

2241 

2248 

2256 

2265 

2275 

2286 


NS  DEV 

analyzed 

AT  THE 

NS  OEV 

FREQ 

O.'.IN 

GAIN 

phase 

(H2) 

(08) 

(OEG) 

.004 

2.971 

9,46 

•324,68 

.010 

1.2GB 

2.20 

-87,99 

.016 

.120  -18,38 

-45.99 

.023 

.487 

-6,25 

•163.38 

.027 

.775 

•2.22 

*95,23 

.037 

.5074 

-5.90 

•149,88 

•  041 

.340 

*9.38 

-145.04 

.049 

.233 

'12.66 

-183.99 

FREQUENCIES 


NS  OEV  MEAN  SQUARE  ERROR  (NSEI 
MSE  ACCOUNTED  FOR  8Y  NS  OEV  FREQUENCIES 
BY  LOK  FREQUENCIES  ONLY 
BY  MI OH  FREQUENCIES  ONLY 
LOK  FREQUENCY  GAIN  « 

LOR  FREQUENCY  CROSSOVER 
LOK  FREQUENCY  PHASE 
HI  FREQUENCY  GAIN 
HI  FREQUENCY  CROSSOVER 
HI  FREQUENCY  PHASE 
EQUIVALENT  TIME  DELAY 


•3.24 

08 

•  01 

HZ 

-155.51 

DEGREES 

-7.54 

OB 

.02 

HZ 

-143.54 

0E3REES 

4.133 

SEC 

60451.86  FT«F 
54466.98  FT»F 
35055.93  FT»F 
27129.41  FT»F 
7926.52  FT»F 


100.00  PCT 
64,36  PCT 
49.81  PCT 
14.55  PCT 


2289 

2292 

2295 

2298 

2301 

2304 

2307 

2310 


2312 

2314 

2316 

2317 

2318 

2319 

2320 

2321 
2327 
2323 
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NS  OEV 

ANALYZED  AT  THE 

FREQ 

ISOLATION 

PHASE 

<MZ> 

(08) 

(DEG) 

.002 

-.76 

-230,20 

.008 

2.16 

-2*7.03 

•  01* 

6.13 

-209.28 

•  020 

*.T2 

-212.68 

.029 

3.03 

-88,48 

•  035 

7.41 

•35.70 

.0*5 

3.16 

-3**. 02 

.063 

•  *.** 

-282.07 

NS  DEV 

MEAN  SQUARE  ERROi 

FREQUENCIES 


MSE  ACCOUNTED  FOR  BY  altitude 
BY  LOB  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 
LOB  FREQUENCY  PHASE 
high  frequency  PHASE 


FREQUENCIES 


-224.80  DEG 
-7*3,77  OEG 


2325 

2327 

2329 

2331 

2333 

233$ 

2337 

2339 

5**66. 9B 

FT«FT 

100.00 

PCT 

11159,90 

FT#FT 

20.49 

PCT 

23*1 

1010S.02 

FT*FT 

11. ss 

PCT 

73*3 

109*. 88 

ft«ft 

1.9* 

PCT 

23*5 
23*6 
73*  T 

NS  OEV 

ANALYZEO  *T  THE  REMNANT 

FREQ 

AMPLITUDE 

(M2) 

(OB) 

.006 

•11.94 

.012 

-IS. 8* 

.018 

-22.2* 

•  021 

-21.59 

.031 

-32. IT 

.039 

-33.41 

.0*7 

-2* .78 

.033 

.38,35 

NS  OEV 

MEAN  SQUARE  ERROR  (MSE) 

FREQUENCIES 


MSE  ACCOUNTED  FOR  By  REMNANT 
BY  LOB  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 


FREQUENCIES 


*4*66. 9B  FTbFT 
SB5T.91  FTbFT 
561(1.66  FTbFT 
2*7.25  FTbFT 


100.00  PCT 
10.75  PCT 
10.30  PCT 
.*5  PCT 


73*‘i 

73*9 

23*0 

2351 

2352 

2353 
235* 
2355 

2357 

2359 

2361 


ALTITUDE  ANALYZED  AT  THE  NS  OEV 


FREQ 

ISOLATION 

phase 

(HZ) 

(OR) 

(DEG) 

.00* 

•  15.08* 

-262.71 

.010 

-10.13 

-276.44 

•  016 

•  10.71 

-292.72 

.023 

-17.52* 

-110,0* 

.027 

-9.06 

-159.03 

.  03T 

-13. 28 

-155.6* 

•  0*1 

-20.13* 

-90,17 

.0*9 

.20,69 

-118.23 

frequencies 


ALTITUOE  MEAN  SQUARE  ERROR 
MSE  ACCOUNTED  FOR  BY  NS  OEV 
BY  LOB  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 
LOB  FREQUENCY  PHASE 
HIGH  FREQUENCY  PHASE 


(MSE) 

FREQUENCIES 


■235,45  DEG 
-189.6*  013 


3537.12  FTbFT 
570. B3  FTbFT* 
521.5o  FTbFT* 
*9.33  FTbFT 


100.00  PCT 
16.1*  PCT 
1*.T*  PCT 
1.39  PCT 


7363 

7365 

2367 

7369 

2371 

2373 

7375 

2377 

2379 

2391 

73B3 

735* 

23S5 


altitude  analyzed  at  THE  altitude  frequencies 


FREQ 

(HZ) 

.002 

•  00B 

.01* 

•  020 
.029 

•  035 

•  0*5 

•  063 


GAIN 


1.082 
1.111 
.762 
.425 
.337 
.092 
.  B6* 
1.9** 


phase 
(DEG) 
-359.96 
•  150.89 
-150.50* 
-190.53 
-117,70 
•306.50 
-1*7,37 
-231.19 


GAIN 
(OB) 

.69 
.91 
-2.36 
-7.4* 

-9.4* 

-20.72 
-1.27 
5.78 

MEAN  SQUARE  FORCING  FUNCTION 
ALTITUDE  MEAN  SQUARE  ERROR  (MSE) 

MSE  ACCOUNTED  FOR  BY  ALTITUOE  FREQUENCIES 
BY  LOB  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 
LOB  FREQUENCY  GAIN 
LOB  FREQUFNCY  CROSSOVER 

lob  frequency  phase 

HI  FREQUENCY  GAIN 
HI  FREQUFNCY  CROSSOVER 
HI  FREQUENCY  PHASE 
EQUIVALENT  TIME  DELAY 


-2.05  00 
.00  HZ 
-212.97*DE3REES 
•6.42  08 
."5  HZ 

•200.69  DEGREES 
6.868  SEC 


9*0.95 

FTbFT 

7388 

2391 

239* 

2397 

2*00 

2*03 

2*06 

2*09 

3537.12 

FTbFT 

100.00 

PCT 

1916.45 

FTbFT 

54.18 

PCT 

2*11 

18**, 97 

FTbFT 

§2.16 

PCT 

2*13 

71.  *8 

FTbFT 

2.02 

PCT 

2*15 

2*16 

2*17 

2*18 

2*19 

2*20 

2*21 

2*22 

ALTITUOE  ANALYZED  AT  THE  REMNANT 


FREQ 

AMPLITUDE 

(HZ) 

(DPI 

.006 

-10.78 

.012 

-u.es 

.018 

-13.18 

.021 

-23.27* 

•  031 

-36,81 

>039 

-30.85 

.  0*T 

-35.07 

.053 

-31  00 

ALTITUOE 

ME*'  SOI 

FREQUENCIES 


SQUARE  ERROR  (MSE) 

MSE  ACCOUNTED  FOR  BY  REMNANT  FREQUENCIES 
BY  LOB  FREQUENCIES  ONLY 
BY  HIGH  FREQUENCIES  ONLY 


3*37, 12 

FTbFT 

100.00 

PCT 

2*23 

7*74 

2*25 

2426 

2*77 

2*21 

2*29 

2*30 

6fl5i46 

FTbFT 

IT. 12 

PCT 

2*32 

597,90 

FTbFT 

16.90 

PCT 

2*3* 

7.56 

FTbFT 

.21 

PCT 

2*36 

69 


APPENDIX D.  LIST  OF  THE  STATISTICALLY  SIGNIFICANT 
VARIABLES  FROM  EXPERIMENT  2 


The  tabular  headings  across  the  page  are  variable  number,  F  value  for  testing  the  equality  of  three 
group  means  (with  2  and  27  df),  significance  level,  mean  value  for  each  group  of  10  5s,  mean  value  for  all 
305s,  and  standard  deviation  within  groups. 


Preceding  page  blank 
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STATISTICALU-SIOnIF  ICANT 


VARIABLE 

F 

SIGNIFICANCE 

8  MEAN 

2 

4.31 

.025 

,999640 

I* 

4.82 

.025 

5.272 

16 

5.96 

.010 

80.631 

18 

4.24 

.050 

245.860 

20 

5.07 

.025 

7.801 

21 

4.29 

.025 

3.872 

22 

4.22 

•  oso 

2.669 

24 

7.96 

.002 

6.492 

25 

4.70 

.025 

.027028 

30 

4.19 

•  050 

•.004018 

33 

5.32 

.025 

*.124395 

34 

4.96 

.025 

-.026789 

44 

4.76 

.025 

.105921 

48 

6.20 

.010 

.094187 

50 

4.16 

•  050 

.075090 

51 

4.66 

.025 

■•122680 

55 

4.80 

.025 

.110092 

62 

7.22 

.005 

.038522 

n 

4.52 

.025 

-.073360 

77 

5.22 

.025 

.080250 

81 

3.53 

.050 

-.106258 

90 

3.67 

.050 

-. 058383 

99 

4.31 

.025 

•126. T65 

100 

3.94 

.050 

2.387 

101 

6.54 

.005 

5.812 

103 

6.50 

.005 

1.085 

104 

6.65 

.005 

-.286 

106 

11.91 

•  001 

.577230 

107 

11.36 

•  001 

-5.611 

109 

10.42 

.001 

.388626 

no 

7.47 

,005 

-9.263 

112 

11.78 

•  001 

.328560 

113 

11.92 

.001 

-9.922 

115 

3.73 

.050 

24.255 

120 

3.38 

.050 

15.818 

121 

6.11 

.010 

22.228 

124 

10.41 

.001 

•6.270 

125 

9.38 

.001 

.109553 

126 

4.00 

.050 

•161.840 

127 

3.52 

.050 

,674040 

*'3 

11.27 

.001 

•19.105 

U 

4.84 

.025 

•95.210 

136 

5.76 

.010 

•7,568 

148 

4.17 

.050 

.338750 

144 

8.01 

.002 

.628 

150 

4,76 

.025 

•166.810 

166 

5.60 

.010 

-50.648 

169 

*.«9 

.059 

•209,677 

186 

4.59 

.025 

•033068 

187 

3.46 

•  050 

.564995 

192 

8.21 

,  902 

•150.478 

193 

4.40 

.025 

18,941 

194 

3,56 

.050 

24.931 

205 

6.14 

.010 

•  813 

206 

5.42 

.025 

•2.722230 

208 

3.87 

.050 

.419671 

209 

3.41 

•  050 

-9,299 

213 

4,08 

.050 

•181.610 

214 

3.38 

.050 

2,628 

218 

4.44 

.025 

1.042880 

222 

7,64 

.005 

-152,744 

223 

4.08 

.050 

•6.019 

224 

4,56 

.025 

.118442 

226 

3,75 

.050 

.481540 

230 

4,02 

.050 

-23,545 

234 

4.66 

.025 

•44.234 

242 

4.18 

.050 

1,002400 

256 

5,70 

.010 

99,469 

257 

*.94 

.025 

19,409 

260 

4.22 

.050 

7,222 

VARIABLES  FROM  EXPERIMENT  2 


I  MEAN 

A  MEAN 

MEAN 

STD.OEy 

.879360 

.546870 

.808623 

.357310 

3.582 

2.912 

3.922 

1.751 

4 j  s988 

34.038 

52.686 

31.788 

182, O^O 

157,010 

195,230 

70,218 

6,3  8 

4,074 

6,074 

2,637 

4.:49 

3.620 

4.081 

.905 

2,355 

1.848 

2.291 

.638 

7.360 

2.336 

4.063 

2.427 

-.  J854  75 

-.046652 

-.035033 

.083361 

046207 

-.024307 

.005961 

.056061 

-.062400 

.164646 

-.007382 

.208562 

-.094982 

.029163 

-.030869 

.088243 

••000634 

.071792 

.059026 

.078904 

.173212 

-.030853 

.078849 

.130724 

-.077361 

.028370 

.005366 

.114704 

.137515 

-.071105 

-.018757 

.201738 

.004369 

•010020 

.041494 

.085867 

-.075119 

.011552 

-.008349 

.069869 

.031502 

.003460 

-.012799 

.080721 

.144660 

,208360 

.144)30 

.088683 

-.059200 

.066143 

-.033105 

.150003 

.030284 

.081661 

.017852 

.117003 

-153,370 

-108.126 

-129.421 

34.644 

3,286 

5.595 

3.756 

2.636 

9.820 

13.614 

9.749 

4.823 

1.317 

1.889 

1.430 

.513 

1.954 

5.187 

2.285 

3.373 

.816420 

1.173060 

.855570 

,274789 

-2.178 

1.122 

-2,222 

3,159 

.482340 

.693590 

.521519 

.153005 

-6,716 

-3.330 

-6.437 

3.444 

.421760 

.522770 

.424363 

•989506 

*7,675 

-5,766 

-7.788 

1.905 

10.618 

6.421 

13.765 

15.271 

20.121 

27,931 

21.290 

10.565 

25,175 

27,358 

24,920 

3.295 

•3,654 

-.697 

-3.540 

2.732 

.149180 

,224440 

.161058 

.060240 

-157.900 

-148.330 

-156.023 

10.986 

,642350 

.554880 

.623757 

.104096 

-24,603 

•29,746 

-24.485 

5.012 

-220,946 

•214,256 

-176,804 

101.685 

-.489 

-11.532 

-6,529 

7.370 

2.021515 

.186526 

.848930 

1.577313 

2.884 

.972 

1.495 

1.359 

-231,240 

-210.480 

-202,843 

47.686 

-59,785 

*62.826 

-57.753 

8.469 

•236,545 

-100  834 

-182,35? 

112.400 

.052529 

.02i408 

.035666 

.023203 

1,049960 

,609350 

.741435 

.455635 

-240.860 

•252,620 

-214,653 

61,689 

32.352 

19.858 

23.717 

11.298 

29,074 

25.693 

26,566 

3.698 

.920 

1.291 

1.006 

.320 

1.048210 

1.9*9130 

-.607103 

3,215141 

.51485J 

• o47 030 

.527184 

.183637 

-6,158 

•4.1)95 

•6,517 

4.485 

•171,530 

•153.020 

•168,720 

22.699 

2,028 

1.521 

2,059 

.953 

1.116300 

,745640 

.968273 

.294392 

-189,270 

•190,600 

-177,538 

24,577 

-3.910 

*1.960 

-3,963 

3.177 

.149846 

.191026 

.153105 

.053884 

.455210 

,354700 

.430483 

.109297 

•27.834 

-13.617 

•21.665 

11.498 

-40,565 

*27.200 

-37.333 

13.130 

•  623UIT 

60,6 ®sr' 

• 

..  ■ 

38.071 

•21,390 

20.43] 

6.150 

33.934 

5,580 

*.205 

5,669 

2.325 

n 


ST AT I  STIC ALLY- SIGN IF 1C ANT  VARIABLES  FROM  EXPERIMENT  2 


VARIABLE 

F 

SIGNIFICANCE 

B  MEAN 

261 

5.95 

.010 

4.5*4 

264 

5.16 

.025 

6.512 

273 

7.14 

.00? 

•.139206 

2BB 

3.50 

.0?0 

•,00676* 

294 

7.12 

•  005 

.230089 

303 

*.35 

.025 

.127851 

304 

*.36 

.025 

-.0*7079 

323 

6.60 

.005 

-.1052*5 

338 

6. OS 

.010 

14.564 

3*1 

3,68 

.050 

8.305 

3*3 

5.76 

.010 

1.13* 

3*4 

♦  i  2* 

.025 

-.095 

3*6 

5.98 

.010 

.665666 

3*7 

*.13 

.050 

•5.095 

3*8 

3.56 

.050 

-150.290 

3*9 

9.2* 

•  001 

,*03260 

35fl 

9,2* 

.001 

•8,6*4 

35? 

8,36 

.002 

.335850 

353 

8,73 

.002 

-9,799 

360 

3,68 

.050 

16,329 

36) 

4.68 

.025 

21.984 

362 

3.61 

.050 

.2*6953 

364 

6.92 

.005 

•5.908 

376 

5.43 

.025 

•9.914 

389 

*.96 

.025 

.712 

*08 

*.08 

.050 

•33,536 

*12 

*.33 

.025 

•20,058 

♦  19 

3.80 

.050 

-157,110 

♦22 

♦  .0* 

,050 

.987050 

*23 

6.10 

.010 

8,685 

♦2* 

*.02 

.050 

.957110 

*25 

6.26 

.010 

8,490 

*29 

6.47 

.010 

•206,080 

♦55 

6.15 

.010 

♦0,*97 

*57  , 

6.09 

.010 

30.402 

*69 

5.42 

.025 

-26,394 

*87 

4.68 

.025 

•1.9*3 

*88 

4.36 

.025 

4,936 

500 

3.53 

.050 

5,775 

549 

*.79 

.025 

-.058129 

555 

2.4* 

.050 

.03*1*5 

577 

*.♦♦ 

.025 

-2.475 

578 

6.75 

.005 

4.750 

590 

3.40 

.050 

11.257 

611 

3.48 

•  050 

.276876 

627 

*.98 

.025 

.769390 

641 

4.26 

.025 

-.*53170 

648 

6.3* 

.010 

•.559290 

651 

3.95 

.050 

379,200 

654 

3,79 

.050 

•*«8*0 

655 

5,18 

.025 

5,017 

660 

3.50 

.050 

90,020 

66  i 

12.84 

,001 

12.187 

663 

4.66 

.025 

134.372 

664 

7,06 

.005 

-107,037 

667 

*.71 

.025 

7,069 

668 

11.77 

.001 

5,586 

669 

*.31 

.025 

3,750 

69l 

8.82 

.001 

.385272 

694 

5.57 

.010 

.167135 

697 

♦  .♦♦ 

.025 

-.215091 

699 

8.4* 

.002 

-.537105 

T&4 

*.63 

.025 

.237085 

712 

5.70 

.010 

.0*6517 

720 

*.17 

.050 

-.138924 

72 1 

6.31 

.010 

-.378760 

723 

5,80 

.010 

-. 561000 

724 

4.86 

.025 

.361146 

73 1 

*.52 

.025 

.*00860 

732 

*.17 

.050 

-.128893 

1  mean 

A  MEAN 

MEAN 

STO.DEv 

5,267 

*.233 

4.681 

.687 

3,883 

2.851 

♦  .*15 

2.628 

-.001906 

.171951 

.010280 

.184490 

,128328 

-.0*5823 

.025247 

.15*536 

.094655 

.025134 

.113293 

.117071 

.112277 

.296912 

.179013 

.155329 

.0*2949 

.01(402 

.002091 

.069028 

•.025951 

.03213* 

-.033021 

.06*856 

21.408 

22.767 

19.560 

5.653 

11,769 

13.465 

11.180 

*.33* 

1.334 

1.769 

1.412 

.428 

2.321 

*.667 

2,298 

3.657 

.765780 

1.035000 

.828815 

.2*3611 

-2,274 

.12* 

-2.415 

4.065 

•136,750 

-137,320 

•1*1,453 

12,835 

.6*3190 

.6566*0 

.534363 

.132016 

-5,387 

*3.807 

-5.946 

2.566 

.396980 

.*86480 

.406437 

.082872 

•8,081 

•6,398 

-8.093 

1.820 

21,002 

29.663 

22,338 

11.166 

27,237 

26.935 

25,385 

4.311 

,330300 

.632210 

.*03154 

.337407 

•3.355 

•1.354 

-3.539 

2.7*4 

•3.186 

•12,230 

-8,444 

6.376 

2.631 

.665 

1.336 

1.593 

•33,939 

•38,300 

-35,258 

4.13* 

-26,721 

•29,588 

-25.456 

7,431 

-256,039 

-255,250 

-222,600 

92.297 

.486550 

.3223*0 

.598647 

.54*755 

6,394 

5.333 

6.871 

2.33* 

.♦♦7730 

.294610 

.566483 

.5*7330 

5,816 

*.856 

6.3B7 

2.379 

•276.420 

•250,960 

•2*4,487 

44.263 

*4,083 

53,126 

♦5.902 

8.297 

31,453 

*-'.327 

34.727 

8.459 

•19,266 

•20.859 

-22.173 

5.082 

-5.426 

-2.597 

-3.322 

2.708 

6,526 

3,280 

♦  .91* 

2.458 

3,810 

2.668 

4,084 

2,645 

-.147780 

.064203 

-.047235 

.153765 

.102043 

-, 294343 

-.052718 

.361342 

-6,954 

•3.424 

-♦.28* 

3.5*2 

8,251 

♦  .374 

5,792 

2.603 

11,20* 

6.2*1 

9,567 

4.9*5 

.038365 

.098624 

.137955 

.210092 

.480830 

,656810 

.635677 

.205997 

-.538190 

-.262992 

-.*18117 

.216009 

-.459660 

-,♦97030 

-.505327 

.063226 

304,662 

234,450 

306,10* 

115.169 

•8,3*4 

-5,284 

-6.156 

3.098 

7,421 

4.448 

5.629 

2.193 

87,683 

84.266 

87.323 

4.895 

7, *88 

6,325 

8,667 

2.739 

68,094 

54,868 

65,778 

62.391 

2.961 

35,160 

•22,959 

66,7*0 

♦  ,590 

2.927 

4,862 

3.037 

7.273 

7.578 

6.812 

.989 

2,754 

2.165 

2.893 

1.220 

.095280 

.076791 

.165781 

.18*191 

-.261128 

-.118506 

-. 070833 

.292277 

-.080901 

.024759 

•.090*11 

.180**2 

-, 106922 

-.09998* 

-.2*800* 

.272511 

.010*52 

•1*0863 

.129*67 

.167169 

.3*2819 

.24*127 

.211154 

.199859 

-.436360 

*, 39*iio 

-.323131 

.2*9230 

-.133594 

-.199885 

-.237413 

.159618 

-.192522 

-.2*1592 

-.331705 

.262623 

.112138 

•115*60 

.196248 

•  20*823 

.20*162 

.183112 

.262711 

.176553 

-.203062 

.127174 

-.068027 

.268776 
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STATISTICALIV-SIONIFICANT 


variable 

F 

SIQNIFICANCE 

8  MEAN 

T39 

7.10 

.005 

1.856 

7*3 

3.91 

.050 

9.837 

7*4 

5.26 

.025 

•10.201 

T*5 

*.♦♦ 

.025 

7,373 

7*8 

3.90 

.050 

406.928 

792 

*.19 

.050 

1120. 

797 

7.85 

.002 

10.857 

799 

5,5* 

•  010 

3,785 

765 

*.♦2 

.025 

.001944 

789 

3.53 

.050 

.430530 

80S 

*.33 

.025 

.387703 

806 

*.*6 

.025 

•.245475 

816 

5.72 

.010 

1.967 

82* 

3.75 

.050 

13.652 

827 

3.** 

.050 

71.694 

83* 

10.81 

.001 

9.459 

8*2 

4.11 

•  050 

•.239479 

8** 

3.48 

.050 

.085470 

892 

3.93 

.050 

.233433 

896 

4.46 

.025 

.111310 

»09 

*.55 

.025 

-.537170 

906 

5.20 

.025 

1.353 

912 

*.01 

.050 

3.070 

915 

4.78 

.025 

102.898 

917 

3.36 

.050 

907.290 

922 

8.63 

.002 

8.901 

92* 

3.86 

.050 

3,279 

926 

*.25 

.025 

12,986 

948 

3.9* 

.050 

063499 

959 

5.38 

.025 

.855190 

968 

3.42 

.050 

,235903 

995 

3.68 

.050 

•.224337 

1009 

4.89 

.025 

-.495440 

1010 

3.74 

.050 

1.384 

1012 

4.66 

.025 

95.115 

1022 

8.45 

.002 

6.121 

102* 

5.58 

.010 

80.978 

1026 

3.38 

.050 

230.120 

1028 

3.4* 

.050 

10.825 

1030 

*.*2 

.025 

2.784 

1032 

5,05 

.025 

5.382 

10*1 

8.10 

.002 

.111522 

109i 

4.03 

.050 

••023515 

1052 

5.03 

.025 

,08)696 

1075 

*.50 

.025 

-.018653 

1076 

3.95 

.050 

-.035073 

1082 

3,66 

.050 

•,025985 

1084 

11.36 

.001 

-.459440 

1108 

3.81 

,'jSO 

5,989 

1109 

5.64 

.010 

14,46.6 

1115 

3.96 

.050 

7.863 

1117 

6.67 

.005 

2,423 

1118 

6.07 

•  010 

6.637 

1120 

5.58 

.010 

1,612 

1121 

7.12 

.005 

3.485 

1123 

3.42 

.050 

1.280 

1124 

6,00 

.010 

1.621 

1126 

7.63 

.005 

1.027 

1127 

7,33 

.005 

-.346 

1129 

5,87 

.010 

.743410 

1130 

6,39 

.010 

•3.254410 

1132 

5,66 

•  010 

.584790 

1133 

6.29 

•  010 

•5.1*7 

1135 

9,38 

.025 

.458720 

1136 

6.41 

.010 

■7,494 

1138 

4.98 

.025 

.371850 

1139 

6,00 

.010 

•9,191 

11*1 

4.41 

.025 

.334530 

11*2 

5,50 

.010 

•10,038 

11** 

6.13 

.010 

.326420 

variables  from  EXPERIMENT  2 


1  MEAN 

A  MEAN 

MEAN 

570. DEV 

1.709 

.960 

1.508 

.571 

8,151 

3.867 

7,285 

5.197 

-14,198 

•7.376 

-10.592 

4.728 

8.665 

4.935 

6.991 

2.84* 

167,948 

380,516 

310,464 

209.696 

1101. 

920. 

1047. 

170> 

9,252 

4.834 

8,314 

3.521 

2,807 

2.053 

2,882 

1.167 

.277550 

.338515 

.206003 

.269657 

.245706 

.095276 

.25717) 

.282628 

,277475 

.004000 

.223059 

.300180 

-.178530 

.659676 

•.121443 

.2402*2 

1,176 

.935 

1.359 

.713 

8,001 

8,080 

9.911 

5.291 

80.541 

76.781 

76.339 

7.571 

5,939 

3.103 

6.167 

3.063 

.031376 

-.024253 

-.077452 

.223195 

.367478 

;215l9S 

.222714 

.239285 

-.056908 

-.080769 

.031919 

.278865 

.263319 

.*97100 

.290576 

.290912 

•.377544 

-.502630 

-.472448 

.124506 

1,096 

.578 

1.009 

.547 

2,162 

1.811 

2.348 

1.026 

111.3*0 

102.307 

105.515 

7,310 

673,160 

904.180 

828.210 

231.803 

6,584 

3.249 

6.245 

3.058 

2.341 

1.692 

2.437 

1.285 

10.592 

4.061 

9.213 

7.082 

.271872 

.0*5534 

.084636 

.272641 

.802540 

.563230 

.7*0320 

.212103 

.0*0*53 

-.0**664 

.077231 

.215954 

.006693 

-.015597 

-.0777*7 

.210046 

-.451220 

-.493570 

-.480077 

.03575* 

1.103 

1.008 

1.165 

.320 

50.070 

33.937 

59,707 

46.451 

4.139 

2.454 

4.238 

1.997 

44,507 

29,991 

51.825 

35.173 

170.990 

125.201 

175,437 

90.493 

8.858 

7.635 

9.106 

2.744 

2.255 

1.662 

2.233 

.844 

4.111 

2.609 

4.03* 

1.95* 

.344720 

.474770 

.310337 

.204553 

.082402 

.168354 

.075747 

.15130* 

.032532 

-.008347 

•035960 

•065029 

.009285 

.074157 

.021596 

.071006 

.000226 

.062629 

.009261 

.078753 

.012461 

.06*545 

.017007 

.075092 

-.328490 

-.176699 

-.3215*3 

.122402 

8.023 

10.702 

8,238 

3.827 

17,357 

20.091 

17.305 

3.74* 

10.847 

13.053 

10.588 

4.140 

2.701 

4.233 

3.119 

1.193 

8,003 

12,154 

8,931 

3.688 

2,337 

3.028 

2.326 

.948 

6,397 

9,362 

6.415 

3.483 

2,207 

2.207 

1.898 

.915 

5,587 

6.710 

4,639 

3,452 

1.262 

1,793 

1.361 

.449 

1.450 

*.803 

1.969 

3.053 

.979010 

1.219210 

.980543 

.310*72 

-.755629 

1 .586260 

-.807926 

3.02813* 

.770000 

.932980 

.762590 

.231578 

•2,881 

-.711 

•2.913 

2.797 

.615400 

.737680 

.60)933 

.19065* 

•4,728 

•2,778 

•5,000 

2,960 

.479970 

.587210 

.479677 

,1526)7 

•6.939 

•4.753 

•6.961 

2.864 

•430030 

.*89020 

.417860 

.117381 

-7,718 

-6,312 

•8.022 

2.537 

.425)90 

.485570 

.405793 

.091438 
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STATISUCALLT-SIONIFICANT 


variable 

F 

SIONIFICaNCE 

8  MEAN 

11*5 

7.65 

.005 

-9.9*7 

IUT 

♦  .39 

.025 

86,437 

11*9 

*.30 

.025 

57.2*7 

1150 

5.32 

.025 

36.830 

1152 

3.8* 

.050 

29,938 

1153 

3.39 

.050 

13.90* 

118* 

5. *6 

.025 

.123817 

1156 

6.89 

.005 

-5.475 

1157 

5.99 

.010 

.1*6*22 

1170 

3.78 

.050 

-37.401 

1173 

*.6* 

.025 

•*5,703 

117a 

7,*1 

.005 

•54.996 

1175 

3.9* 

.050 

-52.551 

uai 

3.98 

.050 

.375**5 

1 1B2 

5.67 

.010 

-.583550 

1195 

6.38 

.010 

6.18* 

1197 

s.;m 

.010 

75.357 

1203 

3.99 

•0S0 

3.606 

1295 

♦  .52 

.025 

6.971 

1209 

7,38 

.005 

-.060928 

1215 

3.45 

.050 

-.0*80*7 

1231 

5.26 

.025 

.056660 

12*5 

5.98 

•  010 

".071550 

12*7 

3,*0 

.050 

-.0*1173 

12*1 

5.01 

.025 

-.315350 

1262 

3.65 

.050 

-.107872 

1266 

3.87 

.050 

.026*86 

1278 

3.9* 

.050 

5,290 

1279 

6. SC 

.005 

13.921 

1284 

7.17 

.005 

*.*00 

1285 

6.1* 

.010 

11.558 

1290 

5.77 

.010 

1.907 

1201 

6.16 

.010 

*.221 

1293 

*.7* 

.025 

1.675 

1294 

8.35 

.002 

3,406 

1306 

*.67 

.025 

-4,5*8 

1311 

11.30 

.001 

.31*600 

1312 

11.10 

.001 

•10.84* 

1314 

8.3* 

.002 

.33*350 

1315 

8.03 

.002 

-9,88/ 

1317 

5.71 

.010 

.3105*9 

1318 

3.01 

•  050 

-11.112 

1320 

3.06 

.050 

35.217 

1322 

4.36 

.025 

27,517 

1325 

3,53 

.050 

5.152 

1326 

8.35 

.002 

10,885 

1327 

*.25 

.025 

.150638 

1329 

6,79 

.005 

-5,735 

1330 

.*.87 

.025 

.1*9987 

1334 

7,82 

.002 

-172,2*0 

1335 

5.75 

.010 

•11,621 

13*4 

3.62 

•  050 

-1*2.151 

136* 

3.7* 

.050 

•110.723 

13*4 

7.23 

•  005 

-151,173 

1392 

7.31 

.005 

•7 17.801 

1305 

3.5* 

.050 

3.92* 

1396 

5.82 

.010 

-116.519 

1307 

7.33 

.005 

1.112 

J309 

5.80 

.010 

-.079 

1*01 

3,*0 

•  050 

-.118 

1*03 

5.31 

.025 

«3.**0 

1*17 

3,55 

.050 

•21,787 

1*26 

*,«5 

.025 

•45 .0** 

1*29 

*.17 

.050 

12.17* 

l*3i 

♦.30 

.025 

11.420 

1*38 

*.08 

.025 

-9*. 105 

1**3 

3.70 

.050 

-22.35* 

6.0* 

.010 

•151.079 

1*52 

*.81 

.025 

-107,197 

1*8* 

5.56 

.010 

-23«. 180 

VARIABLES  FROM  EXPERIMENT  I 


1  MEAN 

*  MEAN 

MEAN 

STO.DEv 

•7.695 

*6.724 

•8,122 

1.890 

51.681 

35,672 

57,997 

39.050 

26.61* 

11.515 

31.792 

35.53* 

20,677 

19.917 

28,808 

11.6*0 

33,5*6 

*2.756 

35.41* 

10.666 

16,580 

16.772 

16,422 

*.16* 

.176070 

.225500 

.175129 

.066833 

•2.960 

-1.022 

-3.152 

2,690 

.200620 

,2507*0 

.199261 

.067*26 

-31.553 

•30.961 

•33,305 

5.790 

•41,31* 

-38,255 

-41,757 

5.496 

-**.002 

•*5.917 

•*6.6 05 

6.456 

•45,393 

•45,07* 

-47,673 

6.720 

.507000 

.552650 

.58*702 

.416796 

-.*7*060 

••5532*0 

-.537*23 

.073571 

3.0*1 

3.203 

*.**♦ 

1.0*4 

*5,220 

35,261 

51,9*6 

27.960 

2,721 

2.331 

2.8*6 

1.035 

5,301 

3.8*2 

5.3*5 

2.300 

-.151627 

-.058979 

-.090511 

.0616*0 

-.116**9 

-.009*92 

-.058009 

.0*72*6 

-.011006 

-.0*2369 

.000765 

.060928 

-.1*5937 

•.0*610* 

-.087863 

.067076 

-.111*72 

-.036707 

-.076584 

.060580 

-.370110 

-.*677*0 

-.38*400 

.109100 

.068057 

.503126 

-.012230 

.1*7320 

.000169 

-.051000 

.021855 

.113771 

13,216 

15,001 

11.169 

8, 2?3 

19,014 

22.267 

18.701 

5.3116 

4,16* 

0.600 

6.058 

3,6»6 

11.509 

18.266 

13.778 

4.959 

2,899 

3.828 

2.87* 

1.265 

8,558 

10.998 

7.925 

♦  .373 

2.031 

♦.395 

2.700 

2.1*7 

5.722 

11.15* 

6.761 

4.351 

•1,179 

-.3*7 

-2.038 

3.235 

,*38920 

.572860 

.**2127 

.121*80 

*7, *57 

-4,9*9 

-7,750 

2.707 

.*01730 

.516*70 

.♦17517 

.100857 

•6,113 

-5,923 

-7,975 

2.216 

.375610 

.**3790 

.383316 

.101762 

-8.6*6 

•6,9*6 

-8.902 

3.3*0 

21.031 

13.5*9 

23.265 

17,462 

12,069 

6.027 

15.20* 

16.7*6 

8,345 

8.238 

7.2*5 

3.051 

14,173 

17,427 

14.162 

3,5*0 

.185850 

.392960 

.243149 

.200705 

•3,385 

-1.49* 

•3,536 

2.570 

.186390 

,2369*0 

.191119 

.062505 

•205,088 

•109,855 

•162,39* 

54.688 

•15,38* 

•21.275 

•16,09* 

6.417 

•217,056 

•118.060 

•150.089 

85,810 

•100,569 

-199,990 

-137,09* 

69,022 

■206,097 

-327, *90 

•258.920 

111,063 

•34,087 

-32.3*3 

-61.710 

56.817 

6,  *87 

1 1,297 

7,237 

6.288 

•66,697 

-80,012 

-87,7*3 

33.619 

6,77* 

10,835 

6,2*1 

5.703 

3,850 

10,663 

*•*11 

7.139 

4.025 

7.7*0 

*•106 

6.85* 

3.071 

6,612 

2,081 

6,997 

•24,78* 

-27,717 

-24.763 

♦  .977 

-♦1,7*7 

•38.260 

•♦1.697 

5.117 

5.871 

3.8*3 

7.296 

6.725 

5.261 

3.060 

6,587 

6,533 

•151,009 

•2*2.856 

•162,687 

106.260 

-25.520 

-30.915 

•26.266 

7,033 

•205,623 

•53.12* 

•1*0.010 

92.512 

•104,792 

•217,955 

•1*3,315 

93.200 

•1*1,220 

-133.765 

•170.055 

75.833 

75 
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STATISTICALLY-SIGNIFICANT  variables  from  EXPERIMENT  2 


VARIABLE 

F 

significance 

S  MEAN 

I  MEAN 

A  MEAN 

MEAN 

STO.OEv 

1*85 

*.13 

.050 

14.2*7 

17,22* 

21.815 

17,762 

5,9*0 

I5p6 

*.20 

.050 

.6*8*20 

.75198® 

.926960 

,775787 

.217292 

1509 

3.77 

.050 

-*.395 

•2.527 

-1.051 

-2.656 

2.729 

1511 

*.60 

.025 

.39118* 

.533960 

.63*810 

.519985 

.180521 

1512 

*.05 

.050 

-9, *81 

-5,496 

-*.527 

-6.568 

4.069 

151* 

7.7* 

.005 

,302660 

.♦203*0 

.5*89*0 

.*23980 

.1*0000 

1515 

7,8* 

.002 

-11.53* 

-7,480 

-5.602 

•8,272 

3.399 

1532 

3,73 

•oSo 

•6,175 

•*,168 

•2,633 

-♦.325 

2.910 

1533 

3. *8 

.050 

.162609 

.189110 

.232670 

.19*796 

.059972 

1539 

.025 

-183,1*0 

-276,660 

-2*9,570 

-237,123 

73,497 

1*02 

3.77 

.050 

•18,785 

-2*,8i  7 

-26,176 

-23,263 

6,*1* 

1606 

19.71 

.001 

-18, *38 

-17.6-  1 

•26,685 

-20.921 

4.839 

161? 

3, *7 

.050 

-16, *79 

•20, *61 

•22,932 

-19.96* 

5,528 

1621 

3.53 

.050 

•23*. 200 

-199,9*0 

•163,6** 

-205,928 

♦3. *53 

1630 

3.93 

.050 

7,2*6 

2,768 

1.415 

3.610 

*.867 

1632 

3,89 

.050 

7.133 

2,635 

1.360 

3.709 

4,66* 

1637 

*.oa 

.OSO 

•267,360 

-239,1*0 

-2*1,290 

•2*9,263 

24,603 

16*0 

6.8* 

.005 

•15,«68 

•13,539 

-2*. 772 

-17.926 

7,260 

16*8 

3.92 

.050 

-11,985 

-1*,257 

•20,280 

-15.508 

6,8*3 

1658 

♦  .03 

.050 

-21.905 

-17,706 

-25,378 

-21,663 

6.0*9 

1667 

♦  .5* 

.025 

•201.090 

•215,656 

-115,370 

-177,372 

80.377 

1693 

3,47 

.050 

.712070 

,780*50 

1.071*50 

.85*657 

.323923 

1695 

7,89 

.002 

•133.1*0 

•98,1*6 

•113,208 

•114.831 

19.762 

1?0* 

5.33 

.025 

*157,090 

•10*,767 

•122.481 

•128,119 

36.*** 

1713 

5.10 

.025 

-213,370 

•167,930 

-161,930 

-181,077 

39.398 

1716 

5.35 

.025 

•229,150 

-167,502 

•166,350 

-194,33* 

*3,160 

W19 

6,70 

.005 

-231. *90 

-160,801 

-204.370 

-205.55* 

30.997 

1725 

8.2* 

.002 

-225.6*0 

-188.220 

-209,260 

-207,707 

20.659 

1726 

3.52 

.050 

17.819 

11,89* 

8.7*3 

12.819 

7.767 

1727 

♦  .30 

.025 

*0.*Q7 

♦2,978 

56,696 

*6.69* 

13,353 

1729 

3. *5 

.050 

36, *80 

39,3*3 

50,3*0 

*2,05* 

12.456 

1737 

7. *6 

.005 

-196,7*0 

-160, *30 

-168,220 

•175,130 

22,126 

1738 

6.52 

.005 

.751890 

.529100 

,59*170 

.625053 

.1*1898 

)T61 

*.80 

.025 

*.♦85790 

-,♦♦5910 

-.♦67220 

-.472973 

.033828 

1773 

3,*1 

.050 

100.16* 

103.350 

101,069 

101.528 

2.813 

1776 

*.05 

.050 

5*. 0*0 

♦1,997 

33,525 

*3.187 

16.200 

1780 

*.13 

.050 

8.333 

6.293 

♦  ,955 

6.527 

2.6*6 

1784 

*.22 

.050 

*,*7* 

3,22* 

2.257 

3,318 

1.711 

1793 

*.01 

.050 

.13*787 

.3*08*1 

.*18120 

.297916 

,231215 

1806 

3.9* 

.050 

-.009359 

.037663 

.032833 

.020379 

.0*1207 

1821 

3,41 

.050 

,805*70 

,58*100 

.57*022 

-  ,65*531 

.223996 

1830 

*.19 

.050 

,080772 

.121*36 

.00567* 

.06929* 

,090683 

1832 

6.35 

.010 

-.052592 

.050763 

.06696* 

.021712 

.081389 

1837 

3.96 

.050 

.059112 

.08593* 

,1763** 

.107797 

.099*27 

1839 

7,10 

,005 

,08*075 

.193720 

.0828** 

.120213 

.07557* 

18*0 

♦  .79 

.025 

-. 009659 

, 023056 

-.002382 

.003939 

.025*77 

18*2 

♦.15 

,050 

.31*995 

.125781 

.159677 

.200151 

.156658 

1850 

3.90 

.050 

-.0*3085 

.036987 

.097266 

,030390 

.1127** 

1367 

3,53 

.050 

10.520 

12.510 

15.1*1 

12.72* 

3.901 

1870 

*.58 

.025 

7,611 

10.873 

12,652 

10.179 

3,779 

1876 

*.35 

.025 

1.7*6 

5,661 

7.500 

♦  .969 

*.*57 

1882 

5.7* 

•  010 

-2.2*5277 

2.0**780 

2.758155 

.852552 

3.573*61 

1884 

3.7* 

.050 

.618700 

,6*3630 

.6735*0 

.812023 

.293*10 

1885 

*.37 

,025 

•*,8*7 

-2.391 

-.365 

-2.5*1 

3.382 

l89p 

5,97 

•  010 

.390970 

.561*60 

.600590 

.517673 

,1**273 

1891 

7. *3 

•  005 

•8.885 

•5,192 

•♦.63* 

-6,237 

2.679 

1892 

*.*6 

.025 

•185,650 

-156,310 

-164,260 

-166.7*0 

22.711 

1893 

6,56 

,005 

.357120 

,*65620 

.529600 

.*50647 

.107711 

189* 

5,90 

.010 

•9,802 

-6,7*4 

•5,59* 

-7, *07 

2.869 

1896 

10. *6 

,001 

,355250 

.♦57570 

.559650 

.*57*90 

.099950 

1897 

11.88 

•  001 

-9,267 

•6.89* 

-5.213 

-7,125 

1.869 

1899 

5,2* 

.025 

50,251 

21. *72 

12,556 

28.093 

27.216 

1901 

5.65 

.025 

*7, *69 

19,382 

10,63* 

£5,825 

27.060 

I9p6 

3.61 

.050 

.158*29 

.213960 

.269820 

,21*070 

,092676 

l9pa 

7.28 

,005 

-*,926 

-2.060 

-,*68 

-2. *85 

2.6*9 

1909 

5. *8 

.025 

,1*9069 

.207822 

.267310 

.208067 

.079892 

1«1 

3.37 

,050 

•3*. 600 

-29,471 

-28,51* 

-30,862 

5.6*1 

193* 

♦  .53 

.025 

-.*8**60 

-,*5o6 t 0 

-.*87630 

-.47*253 

.030*20 

19*7 

3,85 

.050 

*.2*0 

3.890 

2.322 

3.48* 

1.6*7 

1950 

3.55 

.050 

34.719 

-4,175 

♦i,r.9* 

24,613 

*2.010 

76 
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STATISTICALLY-3I0NIFICANT  VARIABLES  FRCH  EXPERIMENT  2 


VARIABLE 

r 

significance 

a  MEAN 

I  MEAN 

A  MEAN 

MEAN 

1956 

*.12 

.050 

-1.651210 

1.1358*9  - 

1.182*80 

-.5659*7 

1957 

*.*8 

.025 

3.667 

3,101 

1.799 

2,856 

1966 

4.37 

.025 

-.1*5823 

.056273 

.162555 

.02*335 

1975 

*.38 

.025 

-.025901 

.16*266 

.071756 

<0700*0 

1977 

5,55 

.010 

.150*89 

.0*1910 

.0*7*50 

.079950 

1983 

*.*3 

.025 

,10*619 

-.009727 

,037626 

.04*173 

2001 

*.07 

.050 

.019*01 

,08835* 

,037110 

.0*8268 

2096 

3.69 

.050 

.02*32* 

.006092 

-.066177 

-.012567 

2099 

5.69 

.010 

-.*15650 

-.350663 

-.213401 

-.326571 

2010 

♦  .39 

.025 

.027915 

.1356*6 

.1*6*16 

.103326 

2026 

3.58 

.050 

•168.378 

•166,003 

-88,767 

-1*1.056 

203' 

*,60 

.025 

•170.550 

-102.627 

-127,273 

•133,483 

20*li 

*.80 

.025 

7,38* 

11.522 

12.133 

10.3*7 

20*3 

*.2* 

.050 

4.64* 

6,078 

10.536 

7,086 

20*9 

4,91 

.025 

-.161 

4,609 

*.833 

3,09* 

20S* 

7.90 

.002 

.623910 

.862690 

1,20*5*0 

,8970*7 

2055 

9,22 

.091 

-*.986 

•1.405 

1.061 

-1,777 

2057 

10.26 

.001 

.461900 

.732290 

.6*6300 

.680163 

2058 

14.76 

.001 

-7.367 

-2.813 

-1.70* 

-3.961 

2060 

13.1* 

•  001 

.3*8780 

.516630 

,66**20 

.5099*3 

2061 

12.25 

.001 

-10.1*9 

•5,888 

-3,697 

•6.585 

2063 

6.71 

.005 

.31*520 

.367100 

.502*80 

.*01367 

206* 

6,76 

.005 

-10.73* 

•8.413 

-6,256 

— 6,468 

2066 

12.13 

.001 

.279190 

.367560 

.466550 

.371100 

2067 

12.02 

.001 

-11,566 

•8,8*6 

•6,738 

•9,050 

2069 

8.61 

.002 

.305750 

.37*500 

.45*980 

.376*10 

2070 

8,50 

.002 

-10. *59 

•8.700 

-7.031 

-6.730 

2072 

5.36 

<025 

1*.3*7 

6,172 

6.569 

9.696 

207* 

6.20 

.010 

9.736 

3,893 

2.426 

5.352 

2075 

*.*8 

.025 

25.186 

15.49* 

1*,007 

18,231 

2081 

12.31 

.001 

•7.171 

•3,840 

-2.152 

-*,387 

2082 

6.11 

.002 

,110171 

.176860 

,215300 

.167*** 

2091 

*.27 

.025 

-29,509 

-23.055 

-24,803 

-25,789 

209* 

3,*0 

.050 

-27.562 

-34,61* 

-25,817 

-29,331 

2096 

*.96 

.025 

-38,st3 

-33,723 

•30.412 

-34.236 

2107 

*.87 

.025 

•1.738 

•1,179 

-1.717 

-1.5*5 

2117 

8.22 

,002 

7189, 

9507, 

6822, 

7839, 

2119 

5.81 

.010 

33.930 

122,459 

•51,200 

35,063 

2120 

6, *8 

•  010 

31. *2* 

53,466 

23,971 

36,287 

2133 

7.17 

.005 

•,286785 

-.251075 

.022317 

-.1718*8 

2138 

3.39 

.050 

-.02*12* 

-.020958 

-.190290 

-.078*57 

21*1 

5,56 

.010 

-.315165 

-.03*911 

-.311170 

-.220*15 

21*2 

5,37 

.025 

-.151693 

.106788 

.209793 

.055629 

?1Si 

*,83 

,025 

.186263 

.,073565 

.192201 

.101633 

2155 

*,03 

.050 

.184360 

-, 030375 

.12*211 

.092732 

2166 

*,37 

.025 

,502510 

.628560 

,*22300 

.517790 

217o 

*.07 

.050 

.279173 

.021236 

,18227* 

,16089* 

2 1 8  i 

*.23 

.050 

•.280066 

.,0*57*6 

-.319933 

-,  2152*8 

2200 

3,36 

.050 

62,6*2 

23,113 

*9,280 

*5,012 

2203 

3,96 

.050 

•1.97* 

•5,552 

-2.017 

-3,181 

2212 

.025 

150. *75 

85,823 

64.363 

100.220 

2213 

*.39 

.025 

59,575 

17,900 

51,753 

*3,076 

2219 

3,36 

•  OSQ 

-1,6*8 

-.059 

•1,560 

-1,069 

2231 

5,73 

.010 

363100 

-.60*710 

-.387790 

-.*53200 

2237 

5,00 

.025 

-.627820 

-.9*54*0 

-.567293 

-.713518 

2239 

3,69 

.050 

166*03 

-.270197 

•,066*18 

-  ,167673 

22*3 

6.63 

.005 

-.096206 

-.568220 

•.1*850* 

-.270977 

22*5 

9,01 

.001 

.000209 

..1*5176 

.066735 

-.026078 

22*8 

9,73 

,001 

.2*5*3* 

.570560 

.202721 

.339572 

2256 

3,69 

.050 

.1180*8 

.26192* 

,223206 

.201060 

2262 

*•03 

.050 

•, 33**30 

-, 5*1760 

-.312208 

-.396133 

2302 

3.59 

,050 

,339760 

.601510 

.319730 

.420333 

2362 

*.  19 

.050 

-2.621 

-9,598 

•10,268 

-7,496 

2368 

3.70 

,050 

•10.586 

-14,276 

•20,365 

-15,083 

237* 

*.** 

.025 

-10.601 

-11,685 

*15,936 

-12,7*1 

2378 

5.2* 

•  Q25 

6060. 

1533, 

881, 

2625, 

2380 

5.22 

.025 

569*. 

1*20. 

835  , 

2716, 

239* 

8.11 

•  002 

-149,0*6 

-211.420 

-111.6*2 

-157,369 

2*18 

8.95 

.001 

-158.450 

-191,390 

•133.207 

•161.016 

2*26 

*.o* 

.050 

•26.325 

-19,647 

-20,792 

-22,255 
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STO.DEV. 

,32*367 

1.A30 

.236917 

.1*3737 

.982063 

.986293 

.936999 

.980618 

.136939 

,098937 

73.661 

90.689 

3.730 

*.721 

*.028 

.328396 

3.167 

.19*9*3 

2.470 

.137760 

2,97* 
.119732 
2.723 
.085088 
2.208 
,080302 
1.860 
5.611 
♦  .878 
9.06* 

2.302 

.059058 

5.111 

7.98* 

5,827 

.43* 

1606. 

113.895 

19.0*9 

.199689 

.166336 

.215533 

.25*526 

.218*37 

.174*61 

.157302 

.20*2*7 

.227883 

34.711 

3.25* 

67.259 

33.425 

1.5*1 

.178719 

.28722* 

.167810 

.317811 

.11*199 

.2039*2 

.122616 

.199321 

.262561 

6.5*0 

8.133 

*.231 

3895. 

3829. 

55.98* 

30.8*8 

5.620 


